-- Logs begin at Thu 2022-07-28 05:44:30 UTC, end at Thu 2022-07-28 06:48:47 UTC. -- Jul 28 06:18:18.461393 dv-cinder-850605-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 06:18:18.474808 dv-cinder-850605-1-smb devstack@keystone.service[89153]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 06:18:18 2022] *** Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: nodename: dv-cinder-850605-1-smb Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: machine: x86_64 Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: clock source: unix Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: pcre jit disabled Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: detected number of CPU cores: 4 Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: current working directory: / Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: detected binary path: /usr/bin/uwsgi-core Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: your processes number limit is 47680 Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: your memory page size is 4096 bytes Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: detected max file descriptor number: 2048 Jul 28 06:18:18.475605 dv-cinder-850605-1-smb devstack@keystone.service[89153]: lock engine: pthread robust mutexes Jul 28 06:18:18.476379 dv-cinder-850605-1-smb devstack@keystone.service[89153]: thunder lock: enabled Jul 28 06:18:18.476379 dv-cinder-850605-1-smb devstack@keystone.service[89153]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 06:18:18.476379 dv-cinder-850605-1-smb devstack@keystone.service[89153]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 06:18:18.514393 dv-cinder-850605-1-smb devstack@keystone.service[89153]: Python main interpreter initialized at 0x56448e6b29c0 Jul 28 06:18:18.514393 dv-cinder-850605-1-smb devstack@keystone.service[89153]: python threads support enabled Jul 28 06:18:18.514393 dv-cinder-850605-1-smb devstack@keystone.service[89153]: your server socket listen backlog is limited to 100 connections Jul 28 06:18:18.514393 dv-cinder-850605-1-smb devstack@keystone.service[89153]: your mercy for graceful operations on workers is 90 seconds Jul 28 06:18:18.514758 dv-cinder-850605-1-smb devstack@keystone.service[89153]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 06:18:18.514758 dv-cinder-850605-1-smb devstack@keystone.service[89153]: *** Operational MODE: preforking *** Jul 28 06:18:18.515074 dv-cinder-850605-1-smb devstack@keystone.service[89153]: *** uWSGI is running in multiple interpreter mode *** Jul 28 06:18:18.515074 dv-cinder-850605-1-smb devstack@keystone.service[89153]: spawned uWSGI master process (pid: 89153) Jul 28 06:18:18.515295 dv-cinder-850605-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 06:18:18.516908 dv-cinder-850605-1-smb devstack@keystone.service[89153]: spawned uWSGI worker 1 (pid: 89166, cores: 1) Jul 28 06:18:18.516908 dv-cinder-850605-1-smb devstack@keystone.service[89153]: spawned uWSGI worker 2 (pid: 89167, cores: 1) Jul 28 06:18:18.516908 dv-cinder-850605-1-smb devstack@keystone.service[89153]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 06:18:23.914215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:18:23.914215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: from cryptography.utils import int_from_bytes Jul 28 06:18:23.915069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:18:23.915069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: from cryptography.utils import int_from_bytes Jul 28 06:18:23.915069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:18:23.915069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: from cryptography.utils import int_from_bytes Jul 28 06:18:23.915703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:18:23.915703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: from cryptography.utils import int_from_bytes Jul 28 06:18:23.963823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:18:23.963998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:18:23.964075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:18:23.964171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:18:23.964238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] command line args: [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:18:23.964377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] command line args: [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:18:23.964461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:18:23.964576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ================================================================================ {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:18:23.964660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:18:23.964774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ================================================================================ {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:18:23.964849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] admin_token = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] admin_token = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] config_dir = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] config_dir = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] config_source = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] debug = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] config_source = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] debug = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.965804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.966991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] list_limit = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] list_limit = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] log_config_append = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967282 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] log_config_append = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] log_dir = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] log_dir = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] log_file = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] log_file = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.967946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.968904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.969994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.970124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.970242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.970360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.970488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.970632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.970762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.970901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.971030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.971155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.971279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.971468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.971588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.971775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.971903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] publish_errors = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] publish_errors = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.972927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.973065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.973221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.973360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.973560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.973696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] standard_threads = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.973823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] standard_threads = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.973956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] use_journal = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] use_journal = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.974939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] use_json = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] use_json = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] use_stderr = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] use_stderr = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] use_syslog = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] use_syslog = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:18:23.975848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.976901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.977907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.978954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.979081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.979306 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.979425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.979540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.979687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.979814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.979935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.980931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.981929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.982880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.983950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.984946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.985985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986236 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.986990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987148 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.987919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.988816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.989914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.990967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.991976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.992884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.993995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.994948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.995960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.996862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.997948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.998995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] auth.external = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] auth.external = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:23.999993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] auth.password = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] auth.password = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] auth.token = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] auth.token = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.000923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.001870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] credential.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] credential.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.002970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.003255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.003335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.003503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.003580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.003774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.003854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.004996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.005074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.005258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.005338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.005509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.005587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.005752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.005829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006467 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.006952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.007917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.008952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009836 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.009914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.010996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.011081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.011307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.011442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.011565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.011736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.011856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.011992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.012117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.012247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.012370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.012496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.012619 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.012751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.012876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.013958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.014968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015467 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015868 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.015992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.016225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.016225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.016476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.016600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.016723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.016848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.016971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.017974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.018985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019626 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019626 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.019998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.020998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.021975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.022142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.022211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.022385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.022454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.022618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.022695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.022980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.023843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.024018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.025870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026272 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026338 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.026995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.027071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.027361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.027435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.027526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.027594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.027780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.027887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.028970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.030550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.030678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.030813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.030938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.031931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.032896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] role.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.033910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] role.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] role.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] role.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.034907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.035961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.036971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.037818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.038949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.039072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.039195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.039319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.039451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.039576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.039761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.039880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.040000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.040149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.040346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.040542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.040726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.040900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.041085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.041261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.041470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.041658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.041859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.042056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.042249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.042462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.042662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.042870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.043069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.043262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.043446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.043664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.043856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.044052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.044255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.044450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.044645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.044859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.045054 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.045248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.045455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.045640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.045809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.046002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.046181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.046364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.046549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.046705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.046871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.047050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.047216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.047390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.047562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.047740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.047946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.048141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.048333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.048511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.048690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.048863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.049026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.049202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.049368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.049536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.049713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.049893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.050053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.050248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.050445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.connection = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.050633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.050827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.051021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.connection = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.051217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.051426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.051638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.051826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.052016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.052186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.052364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.052544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.052688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.052820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.052967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.053969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.054982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.055106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.055238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.055363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.055488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.055611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.055783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.055904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.056035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:18:24.056258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:18:24.056258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:18:24.079422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.079678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.079898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.080828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.081061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.081286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.088367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.089636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.117948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.118170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.118955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.119186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.170229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.170644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.220389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.220651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.220740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.220868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.285170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.285408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.285505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.285663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.285746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.285883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.285967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.286087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.286168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.286286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.286368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.286494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.309483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.309618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.309835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.309921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.310882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.311008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.322198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.322549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.334901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.335995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.336085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.336206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.336329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.336408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.336526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 06:18:24.353414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.353628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 06:18:24.353799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.353974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.354067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 06:18:24.354211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 06:18:24.354308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.354432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.354555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 06:18:24.354634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.354752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.354843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.355005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.355095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.355253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.355528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.364739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.365015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.365138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.365283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.365416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.365498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.365627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.365940 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.372451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.372869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.377113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.377384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.377508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.377655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.377783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.377905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.378031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.378194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.378284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.378405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.378618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.378742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.378927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.379959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.380092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.402628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.403152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.404122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.404395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.404661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.404936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.408994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.409271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.409542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.409667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.409810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.410076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.416335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.416612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.416814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.417076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.420778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.420966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.421219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.421346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.421491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.421636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.421729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.421851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.422010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.422098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.422304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.422495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.422594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.422736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.422856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.423097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.438391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.438666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.439063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.439335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.442566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.443251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.445803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.446094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.446388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.447086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.450882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.451458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.454085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.454736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.457261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.457549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.457832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.457955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.458102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.458247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.458393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.458537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.458663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.458786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.458910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.459232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.474655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.474939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.475142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.475242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.475404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.475486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.475727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.475958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.482457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.482963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.484005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.484287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.484547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.484809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.487068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.487345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.487633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.487778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.487934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.488064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.488188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.488321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.488418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.488736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.499560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.499833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.500137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.500331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.500430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.500575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.500657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.500786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.500937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.501028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.501175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.501262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.501469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.501748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.516806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.517271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.519771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.520238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.522703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.523178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.525185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.525655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.526782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.527060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.527183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.527330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.527476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.527748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.533772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.534270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.535360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.535884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.538360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.538643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.538834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.538928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.539055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.539188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.539310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.539582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.547268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.547550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.547730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.547826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.548047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.548319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.554624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=89167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.554898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.555108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=89166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 06:18:24.555233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.555389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.555472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.555653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.555778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.555908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.556991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.557196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.557323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.557456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.557631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.557758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.557920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.558047 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.558142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.558222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.558431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.558688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 06:18:24.591807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56448e6b29c0 pid: 89167 (default app) Jul 28 06:18:24.592719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56448e6b29c0 pid: 89166 (default app) Jul 28 06:18:24.595056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e4d04-371b-4294-abf3-a29fd07312e2 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:24.595372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e4d04-371b-4294-abf3-a29fd07312e2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:24.595650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e4d04-371b-4294-abf3-a29fd07312e2 None None] PATH_INFO: `/v3` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:24.600007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Thu Jul 28 06:18:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:32.177362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a4bdc-63f8-4caf-a6d6-0715f0f6c44b None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:32.178266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a4bdc-63f8-4caf-a6d6-0715f0f6c44b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:32.178393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a4bdc-63f8-4caf-a6d6-0715f0f6c44b None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:32.186020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:32.192590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:32.193055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:32.193146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:32.263755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: INFO dbcounter [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] Registered counter for database keystone Jul 28 06:18:32.288358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG oslo_db.sqlalchemy.engines [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:18:32.300355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writer thread running {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:18:32.485438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG passlib.handlers.bcrypt [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=89167) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 06:18:32.485853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG passlib.handlers.bcrypt [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89167) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 06:18:32.543710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:32.545307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:32.680147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 06:18:32.849470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a4bdc-63f8-4caf-a6d6-0715f0f6c44b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:32.922540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: INFO dbcounter [None req-3c9a4bdc-63f8-4caf-a6d6-0715f0f6c44b None None] Registered counter for database keystone Jul 28 06:18:32.943800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9a4bdc-63f8-4caf-a6d6-0715f0f6c44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:18:32.955295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writer thread running {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:18:33.087283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a4bdc-63f8-4caf-a6d6-0715f0f6c44b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:33.092611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbd86c-4199-4003-a0db-abe003352d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:33.093256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbd86c-4199-4003-a0db-abe003352d55 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:33.093530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbd86c-4199-4003-a0db-abe003352d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:33.093799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbd86c-4199-4003-a0db-abe003352d55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:33.102996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbd86c-4199-4003-a0db-abe003352d55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:33.154833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING keystone.common.rbac_enforcer.enforcer [None req-39bbd86c-4199-4003-a0db-abe003352d55 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 06:18:33.155167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbd86c-4199-4003-a0db-abe003352d55 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:33.165638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Thu Jul 28 06:18:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:18:33.171994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:33.187183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0152-1c13-4591-8f07-62b7be74c7d9 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:33.192843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab85a4-2e9e-4d1f-b08e-ad26dfa857c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:33.194023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab85a4-2e9e-4d1f-b08e-ad26dfa857c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:33.194302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab85a4-2e9e-4d1f-b08e-ad26dfa857c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:33.194567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab85a4-2e9e-4d1f-b08e-ad26dfa857c9 admin admin] PATH_INFO: `/v3/projects/7b5d9225d0fd499a885320253a91a4b0` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:33.196206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab85a4-2e9e-4d1f-b08e-ad26dfa857c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=7b5d9225d0fd499a885320253a91a4b0)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:33.247068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72ab85a4-2e9e-4d1f-b08e-ad26dfa857c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 06:18:33.247406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab85a4-2e9e-4d1f-b08e-ad26dfa857c9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:33.252128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Thu Jul 28 06:18:33 2022] GET /identity/v3/projects/7b5d9225d0fd499a885320253a91a4b0 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:35.238183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4b586-a331-41a5-969e-2b8d3f587f22 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:35.239066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4b586-a331-41a5-969e-2b8d3f587f22 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:35.239171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4b586-a331-41a5-969e-2b8d3f587f22 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:35.245206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:35.254266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233eb81-e63a-4077-8151-a92ff89b2558 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:35.254672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233eb81-e63a-4077-8151-a92ff89b2558 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:35.254859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233eb81-e63a-4077-8151-a92ff89b2558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:35.283539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5233eb81-e63a-4077-8151-a92ff89b2558 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:35.285035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5233eb81-e63a-4077-8151-a92ff89b2558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:35.294832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 06:18:35.317380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4b586-a331-41a5-969e-2b8d3f587f22 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:35.339955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4b586-a331-41a5-969e-2b8d3f587f22 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:35.346312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4e107-6c93-4e09-bf89-c0d9ba55c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:35.346933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4e107-6c93-4e09-bf89-c0d9ba55c34c admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:35.347217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4e107-6c93-4e09-bf89-c0d9ba55c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:35.347490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4e107-6c93-4e09-bf89-c0d9ba55c34c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:35.355984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4e107-6c93-4e09-bf89-c0d9ba55c34c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:35.357773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4e107-6c93-4e09-bf89-c0d9ba55c34c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:35.366791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Thu Jul 28 06:18:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:18:35.374819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233eb81-e63a-4077-8151-a92ff89b2558 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:35.389851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233eb81-e63a-4077-8151-a92ff89b2558 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:35.398690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883d843-0ebf-4c8c-8488-2d13ea7e51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:35.399689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d843-0ebf-4c8c-8488-2d13ea7e51d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:35.400126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d843-0ebf-4c8c-8488-2d13ea7e51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:35.400381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d843-0ebf-4c8c-8488-2d13ea7e51d5 admin admin] PATH_INFO: `/v3/users/aa34501abc84417abc9f42b1fba8ece5` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:35.401937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883d843-0ebf-4c8c-8488-2d13ea7e51d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa34501abc84417abc9f42b1fba8ece5)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:35.403826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883d843-0ebf-4c8c-8488-2d13ea7e51d5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:35.405394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Thu Jul 28 06:18:35 2022] GET /identity/v3/users/aa34501abc84417abc9f42b1fba8ece5 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:37.431785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa7e20-4538-408c-965a-fae03c590f1f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:37.432331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa7e20-4538-408c-965a-fae03c590f1f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:37.432331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa7e20-4538-408c-965a-fae03c590f1f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:37.433615 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:37.439049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03c6f2-918e-4979-8e17-efc4bf1fd7ee None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:37.439462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03c6f2-918e-4979-8e17-efc4bf1fd7ee None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:37.439741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03c6f2-918e-4979-8e17-efc4bf1fd7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:37.456671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7846d-f826-40ce-8a0c-19e7bafab695 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:37.456955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7846d-f826-40ce-8a0c-19e7bafab695 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:37.457227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7846d-f826-40ce-8a0c-19e7bafab695 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:37.458565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:37.460166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-bd03c6f2-918e-4979-8e17-efc4bf1fd7ee None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:37.461368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bd03c6f2-918e-4979-8e17-efc4bf1fd7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:37.463786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:37.464068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:37.464342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:37.505924 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG passlib.handlers.bcrypt [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=89166) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 06:18:37.506340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG passlib.handlers.bcrypt [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89166) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 06:18:37.543456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:18:37.551440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:37.553246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:37.569080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03c6f2-918e-4979-8e17-efc4bf1fd7ee None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:37.595326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:37.662573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:37.674895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03c6f2-918e-4979-8e17-efc4bf1fd7ee None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:37.684461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:37.709522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:37.710253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:37.710538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:37.710815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:37.722758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:37.731565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:37.732471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:18:37.733268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:37.738916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:37.799676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4c5e0-0b95-412c-a659-0dc44b202cb9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:37.802452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:37.841097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:37.843323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:37.844252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:37.844534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:37.844807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:37.861243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d001-ca07-42f8-880b-910e9c21d104 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:37.896662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:37.897295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:37.897575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:37.897848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:37.898577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:37.898881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:37.900363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:37.912032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:37.912329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:37.913847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:37.917746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:38.014638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:18:38.016303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76e13d-29ea-48ad-9313-9b1bc7e8ad57 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:38.020188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:38.025555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:38.139045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f2a8-94cf-4107-adf3-e7087bcf1716 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:38.162987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:38.163650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:38.163940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:38.164214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] PATH_INFO: `/v3/users/aa34501abc84417abc9f42b1fba8ece5` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:38.165375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=aa34501abc84417abc9f42b1fba8ece5)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:38.166912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:38.168530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:37 2022] GET /identity/v3/users/aa34501abc84417abc9f42b1fba8ece5 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:38.174093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:38.177228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:38.178084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:38.178358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:38.178625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:38.189025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:38.197630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:38.199094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:18:38.217001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:38.217853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:38.218665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:18:38.218665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:18:38.218665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:18:38.218665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:38.218665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:38.224640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:38.280116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66422897-d0e3-4f7c-b61c-ae45ad293cb5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:38.280317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:38.314235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:38.315150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:38.315433 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:38.315715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:38.316940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:38.318404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:38.320281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:38.325504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f1ce-5f3e-4db0-9d51-ec0329d25296 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:38.326209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:38.358909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd99c-7650-497d-9079-c0dcefd7c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:38.359805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd99c-7650-497d-9079-c0dcefd7c512 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:38.360082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd99c-7650-497d-9079-c0dcefd7c512 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:38.360357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd99c-7650-497d-9079-c0dcefd7c512 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:38.361065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd99c-7650-497d-9079-c0dcefd7c512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:38.361369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd99c-7650-497d-9079-c0dcefd7c512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:38.362763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd99c-7650-497d-9079-c0dcefd7c512 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:38.380029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 10/20] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:18:38.421617 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:38.443298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a081c5-bce9-4739-a77f-ec842d1db97a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:38.487458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce75e2-4059-4585-8763-65c8192bc3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:38.488131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce75e2-4059-4585-8763-65c8192bc3f6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:38.488417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce75e2-4059-4585-8763-65c8192bc3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:38.488693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce75e2-4059-4585-8763-65c8192bc3f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:38.489500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce75e2-4059-4585-8763-65c8192bc3f6 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.domain.id=default, user.id=aa34501abc84417abc9f42b1fba8ece5) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:38.489808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce75e2-4059-4585-8763-65c8192bc3f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:38.491290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce75e2-4059-4585-8763-65c8192bc3f6 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:38.499461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 11/21] 10.222.0.58 () {56 vars in 1322 bytes} [Thu Jul 28 06:18:38 2022] GET /identity/v3/role_assignments?user.id=aa34501abc84417abc9f42b1fba8ece5&scope.domain.id=default&role.id=af3b62eec1004adc904a4c278710faee => generated 233 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:40.703240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15c09-c80a-4830-a45d-f6aa8658f7a1 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:40.703849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15c09-c80a-4830-a45d-f6aa8658f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:40.703849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15c09-c80a-4830-a45d-f6aa8658f7a1 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:40.705211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 11/22] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:40.721684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fb3e-9d2a-48ff-8def-662684b33d8d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:40.722173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fb3e-9d2a-48ff-8def-662684b33d8d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:40.722243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fb3e-9d2a-48ff-8def-662684b33d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:40.746160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-59e6fb3e-9d2a-48ff-8def-662684b33d8d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:40.747392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-59e6fb3e-9d2a-48ff-8def-662684b33d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:40.811927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c4f9f-00bd-4f3b-9e31-cd5477a1c512 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:40.812249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c4f9f-00bd-4f3b-9e31-cd5477a1c512 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:40.812505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c4f9f-00bd-4f3b-9e31-cd5477a1c512 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:40.813887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 12/23] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:40.818941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac873-16ff-470e-9f5b-e067a391d2ac None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:40.819226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac873-16ff-470e-9f5b-e067a391d2ac None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:40.819503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac873-16ff-470e-9f5b-e067a391d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:40.848888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4e3ac873-16ff-470e-9f5b-e067a391d2ac None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:40.850096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4e3ac873-16ff-470e-9f5b-e067a391d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:40.866331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 12/24] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:40.914942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fb3e-9d2a-48ff-8def-662684b33d8d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:40.972033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 13/25] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:18:41.006233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ac873-16ff-470e-9f5b-e067a391d2ac None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:41.078826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:41.122676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:41.152369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fb3e-9d2a-48ff-8def-662684b33d8d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:41.213812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5b4b4-b7ea-4b5a-8d6d-f1b5f94fe019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:41.214829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b4b4-b7ea-4b5a-8d6d-f1b5f94fe019 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.215337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b4b4-b7ea-4b5a-8d6d-f1b5f94fe019 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.215943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b4b4-b7ea-4b5a-8d6d-f1b5f94fe019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.223985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ac873-16ff-470e-9f5b-e067a391d2ac None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:41.248737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5b4b4-b7ea-4b5a-8d6d-f1b5f94fe019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:41.250275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5b4b4-b7ea-4b5a-8d6d-f1b5f94fe019 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:41.262875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359373b-8220-4e29-95bd-1eaf17a2bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:41.263846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359373b-8220-4e29-95bd-1eaf17a2bb5f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.264266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359373b-8220-4e29-95bd-1eaf17a2bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.264709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359373b-8220-4e29-95bd-1eaf17a2bb5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-96a5b4b4-b7ea-4b5a-8d6d-f1b5f94fe019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:18:41.270489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:41.271500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:41.272490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:18:41.272490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:18:41.272490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:18:41.272490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:18:41.274028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 13/26] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:18:41.275536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a357-7e84-465b-a351-07cd42d4fa86 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.275962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a357-7e84-465b-a351-07cd42d4fa86 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.276416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a357-7e84-465b-a351-07cd42d4fa86 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.277793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:41.278946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5632ec5-ae65-466e-ae11-e86f8aa9cdd6 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.279609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5632ec5-ae65-466e-ae11-e86f8aa9cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.283608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359373b-8220-4e29-95bd-1eaf17a2bb5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:41.283957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5632ec5-ae65-466e-ae11-e86f8aa9cdd6 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.285342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 15/28] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:41.286408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5632ec5-ae65-466e-ae11-e86f8aa9cdd6 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-f359373b-8220-4e29-95bd-1eaf17a2bb5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:41.292711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:41.293750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:41.294686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:41.297177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 14/29] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:18:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:18:41.298564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8d4a-68a4-401b-afde-50dc567f84cc None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.298947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8d4a-68a4-401b-afde-50dc567f84cc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.299333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8d4a-68a4-401b-afde-50dc567f84cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.318817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-425d8d4a-68a4-401b-afde-50dc567f84cc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:41.320300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-425d8d4a-68a4-401b-afde-50dc567f84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:41.399651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 15/30] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:41.399651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fdf17-417c-41e9-9df5-f3209f127963 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.399651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fdf17-417c-41e9-9df5-f3209f127963 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.399651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fdf17-417c-41e9-9df5-f3209f127963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.409626 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5632ec5-ae65-466e-ae11-e86f8aa9cdd6 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:41.453028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:41.463842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:41.464769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.465187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.465593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.466437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:41.466886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:41.468486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:41.489042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 16/31] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:41.490209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:41.537726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-656fdf17-417c-41e9-9df5-f3209f127963 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:41.539146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-656fdf17-417c-41e9-9df5-f3209f127963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:41.570701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:41.599046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351436-7af8-49a8-93d3-1ef5386f705f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:41.619887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 16/32] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:41.621006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fdf17-417c-41e9-9df5-f3209f127963 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:41.646176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:41.647084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.647501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.648887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.649771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:41.650112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:41.651514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:41.662644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 17/33] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:41.663548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:41.725609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:41.759346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fdf17-417c-41e9-9df5-f3209f127963 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:41.797222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d426-778b-432e-8917-4c2767ae9af5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:41.802613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:41.803254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.803531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.803830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.804543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:41.805928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:41.841942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:41.842963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:41.843520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:41.844113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:41.845086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:41.846771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:41.936261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 17/34] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Jul 28 06:18:41 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:41.944770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:42.002554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 18/35] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:18:41 2022] POST /identity/v3/projects => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:42.004232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:42.018025 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:42.134144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:42.138861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1602-e72d-4891-b170-aebf72d27962 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:42.183758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab28f-a164-4e30-8757-dd5849d27db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:42.184840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab28f-a164-4e30-8757-dd5849d27db9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.185385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab28f-a164-4e30-8757-dd5849d27db9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.185964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab28f-a164-4e30-8757-dd5849d27db9 None admin] PATH_INFO: `/v3/users/aa34501abc84417abc9f42b1fba8ece5` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.187635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab28f-a164-4e30-8757-dd5849d27db9 None admin] RBAC: Authorizing `identity:get_user(user_id=aa34501abc84417abc9f42b1fba8ece5)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:42.189714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab28f-a164-4e30-8757-dd5849d27db9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:42.191655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 19/36] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:42 2022] GET /identity/v3/users/aa34501abc84417abc9f42b1fba8ece5 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:42.193258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a0a1-2fb5-42d6-87d7-74f034c7dce4 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.193910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a0a1-2fb5-42d6-87d7-74f034c7dce4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.194381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a0a1-2fb5-42d6-87d7-74f034c7dce4 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.196214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 20/37] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:42.199601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a0a1-2fb5-42d6-87d7-74f034c7dce4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:42.207265 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25818-4e18-49b5-bc33-d2b38b39c5f4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:42.249677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108dfb4-db18-4cde-98c2-aef4519822ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:42.250327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108dfb4-db18-4cde-98c2-aef4519822ef None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.250614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108dfb4-db18-4cde-98c2-aef4519822ef None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.250899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108dfb4-db18-4cde-98c2-aef4519822ef None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.251670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108dfb4-db18-4cde-98c2-aef4519822ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:42.253783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108dfb4-db18-4cde-98c2-aef4519822ef None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:42.273928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 18/38] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Jul 28 06:18:41 2022] POST /identity/v3/roles => generated 219 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:42.275679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545934-7c5c-4c8a-a37d-741019436a78 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.276152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545934-7c5c-4c8a-a37d-741019436a78 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.276587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545934-7c5c-4c8a-a37d-741019436a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.304913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2e545934-7c5c-4c8a-a37d-741019436a78 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:42.306601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2e545934-7c5c-4c8a-a37d-741019436a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:42.314650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a0a1-2fb5-42d6-87d7-74f034c7dce4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:42.355781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723d347-838d-449a-aef1-8a7d5f2b0bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:42.356588 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723d347-838d-449a-aef1-8a7d5f2b0bb8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.356887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723d347-838d-449a-aef1-8a7d5f2b0bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.357176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723d347-838d-449a-aef1-8a7d5f2b0bb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.358641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723d347-838d-449a-aef1-8a7d5f2b0bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:42.360188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723d347-838d-449a-aef1-8a7d5f2b0bb8 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:42.366818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 21/39] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:42.366818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f657a8-5922-4feb-849e-b785332a9373 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.366818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f657a8-5922-4feb-849e-b785332a9373 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.366818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f657a8-5922-4feb-849e-b785332a9373 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.366818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 22/40] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:42.370971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f657a8-5922-4feb-849e-b785332a9373 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:42.388482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 19/41] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:42.390151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec831-2cf0-43c7-b704-0281c71c3d46 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.390634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec831-2cf0-43c7-b704-0281c71c3d46 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.391065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec831-2cf0-43c7-b704-0281c71c3d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.415601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-419ec831-2cf0-43c7-b704-0281c71c3d46 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:42.417211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-419ec831-2cf0-43c7-b704-0281c71c3d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:42.425058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:42.429388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:42.499955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 20/42] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:42.500878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ec831-2cf0-43c7-b704-0281c71c3d46 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:42.501438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f657a8-5922-4feb-849e-b785332a9373 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:42.536463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:42.537072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.537356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.537628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] PATH_INFO: `/v3/domains/default/users/aa34501abc84417abc9f42b1fba8ece5/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.539585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=aa34501abc84417abc9f42b1fba8ece5, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:42.541187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:42.555348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 23/43] 10.222.0.58 () {58 vars in 1361 bytes} [Thu Jul 28 06:18:42 2022] PUT /identity/v3/domains/default/users/aa34501abc84417abc9f42b1fba8ece5/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:42.556207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:42.613693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ec831-2cf0-43c7-b704-0281c71c3d46 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:42.655169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:42.656649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.657160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.657910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.659126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:42.661366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:42.675275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:42.681926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 21/44] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Jul 28 06:18:42 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:42.683946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff435-47a1-464a-b31f-8d2a7d4c06e1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:42.728524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef401-1ba6-4247-8eb3-88d8c6f1d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:42.729268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef401-1ba6-4247-8eb3-88d8c6f1d073 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.729608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef401-1ba6-4247-8eb3-88d8c6f1d073 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.729925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef401-1ba6-4247-8eb3-88d8c6f1d073 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.731250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef401-1ba6-4247-8eb3-88d8c6f1d073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:42.732762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef401-1ba6-4247-8eb3-88d8c6f1d073 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:42.734439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 24/45] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:42.743433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:42.751426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:42.853434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54793521-9513-4962-b89a-29b3acc9fa9a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:42.888140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202c8cc-eff6-4787-a36d-731dd66bb158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:42.888790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c8cc-eff6-4787-a36d-731dd66bb158 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:42.889075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c8cc-eff6-4787-a36d-731dd66bb158 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:42.889354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c8cc-eff6-4787-a36d-731dd66bb158 None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:42.890321 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202c8cc-eff6-4787-a36d-731dd66bb158 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:42.891825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202c8cc-eff6-4787-a36d-731dd66bb158 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:42.921136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 22/46] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:18:42 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:44.544422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446af86-a005-473f-b3d7-04e851e11382 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:44.545029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446af86-a005-473f-b3d7-04e851e11382 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:44.545029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446af86-a005-473f-b3d7-04e851e11382 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:44.546341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 25/47] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:44.551677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64f73-63e5-448d-8dba-04783fdb96d4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:44.552084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64f73-63e5-448d-8dba-04783fdb96d4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:44.552275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64f73-63e5-448d-8dba-04783fdb96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:44.571396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d7e64f73-63e5-448d-8dba-04783fdb96d4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:44.572969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d7e64f73-63e5-448d-8dba-04783fdb96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:44.630740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:44.646551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 23/48] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:44.669392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446af86-a005-473f-b3d7-04e851e11382 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:44.772233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446af86-a005-473f-b3d7-04e851e11382 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:44.806847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee5110-d640-4ce0-ba13-ad8f73aefc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:44.807418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee5110-d640-4ce0-ba13-ad8f73aefc1c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:44.807707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee5110-d640-4ce0-ba13-ad8f73aefc1c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:44.808004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee5110-d640-4ce0-ba13-ad8f73aefc1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:44.818993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee5110-d640-4ce0-ba13-ad8f73aefc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-06ee5110-d640-4ce0-ba13-ad8f73aefc1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:44.824363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:44.825225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:18:44.826157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 26/49] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:18:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:44.831571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e64f73-63e5-448d-8dba-04783fdb96d4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:44.895548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f56f0-f4fc-4107-921c-5967cdd91bec None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:44.895881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f56f0-f4fc-4107-921c-5967cdd91bec None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:44.896185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f56f0-f4fc-4107-921c-5967cdd91bec None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:44.897548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 27/50] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:18:44.902419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fcb4b-254d-46f0-937b-2476c5f6447d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:44.902708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fcb4b-254d-46f0-937b-2476c5f6447d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:44.902985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fcb4b-254d-46f0-937b-2476c5f6447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:44.922677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a21fcb4b-254d-46f0-937b-2476c5f6447d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:44.924244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a21fcb4b-254d-46f0-937b-2476c5f6447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:44.934019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e64f73-63e5-448d-8dba-04783fdb96d4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:44.941751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:44.967654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:44.968301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:44.968576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:44.968850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:44.969563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:44.969864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:44.971251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:44.983224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 24/51] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:44.988887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:44.992240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 28/52] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:45.014577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fcb4b-254d-46f0-937b-2476c5f6447d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:45.041941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:45.092135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223dd9-82dc-44f7-baea-572d8257b240 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:45.114218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fcb4b-254d-46f0-937b-2476c5f6447d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:45.127180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:45.127875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:45.128157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:45.128430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] PATH_INFO: `/v3/users/aa34501abc84417abc9f42b1fba8ece5` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:45.129850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] RBAC: Authorizing `identity:get_user(user_id=aa34501abc84417abc9f42b1fba8ece5)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:45.131303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:45.132977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 25/53] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:44 2022] GET /identity/v3/users/aa34501abc84417abc9f42b1fba8ece5 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:45.138636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:45.151824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:45.152479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:45.152796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:45.153072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:45.154281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:45.155764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:45.157394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 29/54] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:45.163102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:45.187061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:45.238662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0227e3-60a2-40f3-87bb-855ef32aea4e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:45.256027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:45.263413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf366e3-2c1e-491a-b72f-be55766535dc None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:45.273805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:45.274468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:45.274752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:45.275119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:45.276337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:45.277825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:45.279646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 26/55] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:45.285275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:45.298662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6901ec1-708b-438f-abfe-134ac2d12d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:45.299300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901ec1-708b-438f-abfe-134ac2d12d81 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:45.299587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901ec1-708b-438f-abfe-134ac2d12d81 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:45.299906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901ec1-708b-438f-abfe-134ac2d12d81 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:45.300594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6901ec1-708b-438f-abfe-134ac2d12d81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:45.302057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6901ec1-708b-438f-abfe-134ac2d12d81 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:45.329785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 30/56] 10.222.0.58 () {60 vars in 1140 bytes} [Thu Jul 28 06:18:45 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:18:45.390628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58819b0-0a9c-494c-8af9-02b0ad2fdf95 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:45.428291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3768b40-6a96-4340-8ed4-932ae9fd58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:45.428931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768b40-6a96-4340-8ed4-932ae9fd58c4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:45.429211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768b40-6a96-4340-8ed4-932ae9fd58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:45.429471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768b40-6a96-4340-8ed4-932ae9fd58c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:45.430270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3768b40-6a96-4340-8ed4-932ae9fd58c4 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.domain.id=default, user.id=aa34501abc84417abc9f42b1fba8ece5) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:45.430580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3768b40-6a96-4340-8ed4-932ae9fd58c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:45.432141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3768b40-6a96-4340-8ed4-932ae9fd58c4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:45.442464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 27/57] 10.222.0.58 () {56 vars in 1322 bytes} [Thu Jul 28 06:18:45 2022] GET /identity/v3/role_assignments?user.id=aa34501abc84417abc9f42b1fba8ece5&scope.domain.id=default&role.id=af3b62eec1004adc904a4c278710faee => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:47.302716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015a8f0-45d4-4fa0-bb85-5301eac944b1 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:47.303502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015a8f0-45d4-4fa0-bb85-5301eac944b1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:47.303502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015a8f0-45d4-4fa0-bb85-5301eac944b1 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:47.305676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 31/58] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:47.312031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a62f-8063-4969-96ea-5fc1d300cb92 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:47.312492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a62f-8063-4969-96ea-5fc1d300cb92 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:47.312589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a62f-8063-4969-96ea-5fc1d300cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:47.341125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-94c7a62f-8063-4969-96ea-5fc1d300cb92 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:47.342325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-94c7a62f-8063-4969-96ea-5fc1d300cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:47.390193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:47.412279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 28/59] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:47.436700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015a8f0-45d4-4fa0-bb85-5301eac944b1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:47.523991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:47.563828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015a8f0-45d4-4fa0-bb85-5301eac944b1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:47.599112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae4f3d-8da2-45ad-be35-fdbd929b293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:47.599776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae4f3d-8da2-45ad-be35-fdbd929b293c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:47.600062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae4f3d-8da2-45ad-be35-fdbd929b293c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:47.600336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae4f3d-8da2-45ad-be35-fdbd929b293c None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:47.601554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae4f3d-8da2-45ad-be35-fdbd929b293c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:47.603069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae4f3d-8da2-45ad-be35-fdbd929b293c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:47.605088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 32/60] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:47.613349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7a62f-8063-4969-96ea-5fc1d300cb92 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:47.724903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7a62f-8063-4969-96ea-5fc1d300cb92 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:47.761433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fc3ca-28da-43bb-8a62-03398454f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:47.762066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fc3ca-28da-43bb-8a62-03398454f973 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:47.762342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fc3ca-28da-43bb-8a62-03398454f973 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:47.762618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fc3ca-28da-43bb-8a62-03398454f973 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:47.763290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fc3ca-28da-43bb-8a62-03398454f973 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:47.764775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fc3ca-28da-43bb-8a62-03398454f973 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:47.793528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 29/61] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:18:47 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:50.877768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cc3a4-799a-49ea-b37a-cdafe44a92f8 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:50.878290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cc3a4-799a-49ea-b37a-cdafe44a92f8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:50.878363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cc3a4-799a-49ea-b37a-cdafe44a92f8 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:50.879698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 33/62] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:50.884995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644683bd-83c9-4620-bcb4-ad760b4f6c3f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:50.885447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644683bd-83c9-4620-bcb4-ad760b4f6c3f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:50.888266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644683bd-83c9-4620-bcb4-ad760b4f6c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:50.909530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-644683bd-83c9-4620-bcb4-ad760b4f6c3f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:50.910951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-644683bd-83c9-4620-bcb4-ad760b4f6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:50.948730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:51.005956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 30/63] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:51.037294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2bda8-ef8b-403f-85f1-9c046fa2c125 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.037858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2bda8-ef8b-403f-85f1-9c046fa2c125 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.038377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2bda8-ef8b-403f-85f1-9c046fa2c125 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.040074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 34/64] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:51.040555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644683bd-83c9-4620-bcb4-ad760b4f6c3f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.046112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db7e8-8e1f-445a-bfbe-3d47608a209e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.046689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db7e8-8e1f-445a-bfbe-3d47608a209e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.047151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db7e8-8e1f-445a-bfbe-3d47608a209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.078290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-408db7e8-8e1f-445a-bfbe-3d47608a209e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:51.079509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-408db7e8-8e1f-445a-bfbe-3d47608a209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:51.145032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644683bd-83c9-4620-bcb4-ad760b4f6c3f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.181700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.182642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.183063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.183477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.195561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:51.202068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:51.203137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:51.204108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:51.206120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 31/65] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:18:51.212087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.227283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 35/66] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:51.232659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9aa4-ea92-4643-b4c7-30db37d0f5a4 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.232958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9aa4-ea92-4643-b4c7-30db37d0f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.233302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9aa4-ea92-4643-b4c7-30db37d0f5a4 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.234606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 36/67] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:18:51.239553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e440259-72f7-420d-bc50-3ca263cfa580 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.240035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e440259-72f7-420d-bc50-3ca263cfa580 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.240459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e440259-72f7-420d-bc50-3ca263cfa580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.244801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:51.266919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-0e440259-72f7-420d-bc50-3ca263cfa580 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:51.268524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0e440259-72f7-420d-bc50-3ca263cfa580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:51.330107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ffc77-bd7a-44da-9eb8-2dfc843b5795 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.339278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 37/68] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:18:51.340456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e440259-72f7-420d-bc50-3ca263cfa580 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.342996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:51.367109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449893b5-3c02-44db-bfe3-309009fdcaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.367794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449893b5-3c02-44db-bfe3-309009fdcaab None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.368081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449893b5-3c02-44db-bfe3-309009fdcaab None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.368358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449893b5-3c02-44db-bfe3-309009fdcaab None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.369110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449893b5-3c02-44db-bfe3-309009fdcaab None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:51.369415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449893b5-3c02-44db-bfe3-309009fdcaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:51.370815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449893b5-3c02-44db-bfe3-309009fdcaab None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:51.379863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 32/69] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:18:51.385263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce628-0b5a-416a-ac3c-15e6c6273114 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.385551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce628-0b5a-416a-ac3c-15e6c6273114 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.385830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce628-0b5a-416a-ac3c-15e6c6273114 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.387367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 33/70] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:51.392126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce628-0b5a-416a-ac3c-15e6c6273114 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.442999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e440259-72f7-420d-bc50-3ca263cfa580 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.477619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.478377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.478659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.480220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.488896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:51.490319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:51.495761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:51.496803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:18:51.497578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 38/71] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:51.498350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.512618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce628-0b5a-416a-ac3c-15e6c6273114 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.552625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bdc02-8530-4518-adf9-31a3ef40aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.553282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bdc02-8530-4518-adf9-31a3ef40aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.553565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bdc02-8530-4518-adf9-31a3ef40aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.553840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bdc02-8530-4518-adf9-31a3ef40aaa1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.563909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bdc02-8530-4518-adf9-31a3ef40aaa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:51.567838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-864bdc02-8530-4518-adf9-31a3ef40aaa1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:51.570352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:51.571224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:51.572671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 34/72] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:51.573283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393390e7-9135-4157-ba69-2a9d356d17af None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.573357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393390e7-9135-4157-ba69-2a9d356d17af None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.573999 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393390e7-9135-4157-ba69-2a9d356d17af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.591669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-393390e7-9135-4157-ba69-2a9d356d17af None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:51.593012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-393390e7-9135-4157-ba69-2a9d356d17af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:51.612662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4bc9e-8835-4439-ae25-ead91fb41914 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.645563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e953b-fbfd-499b-b024-2b277130242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.646206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e953b-fbfd-499b-b024-2b277130242a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.646486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e953b-fbfd-499b-b024-2b277130242a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.646757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e953b-fbfd-499b-b024-2b277130242a None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.659634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e953b-fbfd-499b-b024-2b277130242a None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:51.661134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e953b-fbfd-499b-b024-2b277130242a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:51.661251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 35/73] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:51.667196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 39/74] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:51.667196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b66ac-4408-4a54-92b7-fc5f38f7a7c3 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.667196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b66ac-4408-4a54-92b7-fc5f38f7a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.667462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393390e7-9135-4157-ba69-2a9d356d17af None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.667533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b66ac-4408-4a54-92b7-fc5f38f7a7c3 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.667533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 40/75] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:51.667533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b66ac-4408-4a54-92b7-fc5f38f7a7c3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.745749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:51.767583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393390e7-9135-4157-ba69-2a9d356d17af None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.772669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b66ac-4408-4a54-92b7-fc5f38f7a7c3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.792338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:51.800712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.801353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.801635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.801913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.802634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:51.802940 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:51.804364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:51.807225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396df7e-bae1-42c9-b37f-68f1be782ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.807984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396df7e-bae1-42c9-b37f-68f1be782ac3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.808238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396df7e-bae1-42c9-b37f-68f1be782ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.808511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396df7e-bae1-42c9-b37f-68f1be782ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.809227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396df7e-bae1-42c9-b37f-68f1be782ac3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:51.809528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396df7e-bae1-42c9-b37f-68f1be782ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:51.810895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396df7e-bae1-42c9-b37f-68f1be782ac3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:51.812433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 36/76] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:51.813228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.823819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 41/77] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:51.826650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b0c6-a018-40ad-b133-7014b79473dd None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.826943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b0c6-a018-40ad-b133-7014b79473dd None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.827223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b0c6-a018-40ad-b133-7014b79473dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.845295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6237b0c6-a018-40ad-b133-7014b79473dd None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:51.846512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6237b0c6-a018-40ad-b133-7014b79473dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:51.915176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697c239-7685-42bd-9ecc-3ec16669fa71 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:51.916850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 42/78] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:51.927997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b0c6-a018-40ad-b133-7014b79473dd None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:51.963448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:51.964120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:51.964404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:51.964689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:51.975136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.015862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b0c6-a018-40ad-b133-7014b79473dd None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.029349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.035140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.036671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.050572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.051229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.051514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.051787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.062027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:52.067015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:52.068067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 43/79] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:52.069024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.136190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 37/80] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:18:52.137053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.169231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114c02-8d5e-4306-ad5c-937be0e522d4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.179509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.206573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.207826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.208104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.208373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] PATH_INFO: `/v3/users/aa34501abc84417abc9f42b1fba8ece5` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.209547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] RBAC: Authorizing `identity:get_user(user_id=aa34501abc84417abc9f42b1fba8ece5)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.212442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.214078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 44/81] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/users/aa34501abc84417abc9f42b1fba8ece5 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:52.214845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.243909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009120e-f28d-4b6a-a4ca-0a15c6eb6ef5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.255664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.277428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.278021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.278304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.278586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.279775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.281243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.282892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 38/82] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:52.283964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.314271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a4525-19c6-4904-8843-44b601aad3fe None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.349410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.350063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.350351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.350658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.351844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.353366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.355005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 45/83] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:52.359671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.383931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9e556-212d-4b4c-beae-281065a98a8a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.392985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.420476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.421116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.421393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.421662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.422377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:52.422686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.424129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.432551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 39/84] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:52.433346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.455878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c2338-cf33-4708-8b4c-45cdb3cd07f8 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.465302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.493323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.494061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.494343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.494618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.495825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.497329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.499022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 46/85] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:52.499813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.536444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216675-c8d0-4805-8f8a-8b8479193f7a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.570117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.570736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.571015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.571287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.597620 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfa1ec-618f-45a9-8df4-3a25052d41d5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.610503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.633391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.634101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.634492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.634836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.639239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.640757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.678566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.701807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.703305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.738215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 40/86] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:18:52.739093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.802136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 47/87] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:18:52.802736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.808410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.841660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109a95-15a9-498c-9a3a-aafe81506acf None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.875544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.876214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.876486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.876781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.876893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:52.877464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.878996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.899815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 41/88] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:18:52 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:52.900540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7979f-4f6f-4014-912b-1338483d3216 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:52.900642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:52.953517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:52.954364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:52.954714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:52.954997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:52.956324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:52.957851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:52.959605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 48/89] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:52.959605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:53.029139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7f86c-6427-4365-a0d1-79b430a46a84 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.061456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:53.073221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b43eb-6e6b-4a2a-81cc-319ecab5fe1a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.073377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.073660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.073953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.074234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.075068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=8d7618d1e3264e288a59b8636924711f) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:53.075372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.077121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.083760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 42/90] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/role_assignments?user.id=8d7618d1e3264e288a59b8636924711f&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:53.084686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:53.129903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.130478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.131104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.131104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.133750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.135675 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.136952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 49/91] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:52 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:53.138150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:53.153743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:53.225209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8041c43-312a-4066-a3f8-0fd828db7838 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.270699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.271465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.272273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.272273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.274254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.275990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.278071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4ce97-7112-4bdd-841b-2186443b401a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.279745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 43/92] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:53 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:53.280626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:53.320571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.321131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.321465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.321841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.357080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:53.402928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181aa65-7d50-47e0-a262-7f0ebce3cc3b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.408650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.410147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.425702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:53.442434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.443079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.443360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.443660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.444461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=aa34501abc84417abc9f42b1fba8ece5) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:53.444778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.446228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.452570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 44/93] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:18:53 2022] GET /identity/v3/role_assignments?user.id=aa34501abc84417abc9f42b1fba8ece5&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:53.453389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:53.562326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b69183-b1be-4a51-9045-22a649bed761 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.585429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 50/94] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:18:53.587749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:53.596767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:53.602814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.603535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.603848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.604127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.604922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] RBAC: Adding query filter params (role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=8d7618d1e3264e288a59b8636924711f) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:53.605235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.606750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.612819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 45/95] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:18:53 2022] GET /identity/v3/role_assignments?user.id=8d7618d1e3264e288a59b8636924711f&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:53.739810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133052d-b937-4e07-b7ff-de3a8952d3c4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.758050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:53.782215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca1a0a-d762-4f57-a2b5-4707aa63f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.782896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1a0a-d762-4f57-a2b5-4707aa63f993 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.783179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1a0a-d762-4f57-a2b5-4707aa63f993 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.783455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1a0a-d762-4f57-a2b5-4707aa63f993 None admin] PATH_INFO: `/v3/projects/8165d240247d41678ad1cb76e2f288cf` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.784692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca1a0a-d762-4f57-a2b5-4707aa63f993 None admin] RBAC: Authorizing `identity:get_project(project_id=8165d240247d41678ad1cb76e2f288cf)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.786172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca1a0a-d762-4f57-a2b5-4707aa63f993 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.787909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 51/96] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:53 2022] GET /identity/v3/projects/8165d240247d41678ad1cb76e2f288cf => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:53.794308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:53.911371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65e8fd-dec6-4b88-b377-3469fbeab8ae None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:53.947396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03716d-6a72-4432-8507-c77fa2fec902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:53.948420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03716d-6a72-4432-8507-c77fa2fec902 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:53.948923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03716d-6a72-4432-8507-c77fa2fec902 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:53.949389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03716d-6a72-4432-8507-c77fa2fec902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:53.950396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03716d-6a72-4432-8507-c77fa2fec902 None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=8165d240247d41678ad1cb76e2f288cf, user.id=8d7618d1e3264e288a59b8636924711f) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:53.950929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03716d-6a72-4432-8507-c77fa2fec902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:53.952605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03716d-6a72-4432-8507-c77fa2fec902 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:53.958827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 46/97] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:18:53 2022] GET /identity/v3/role_assignments?user.id=8d7618d1e3264e288a59b8636924711f&scope.project.id=8165d240247d41678ad1cb76e2f288cf&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:55.464001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ac49-d048-427a-a183-e2398fb2a0d0 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:55.464498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ac49-d048-427a-a183-e2398fb2a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:55.464594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ac49-d048-427a-a183-e2398fb2a0d0 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:55.466130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 52/98] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:55.471468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571292e4-f5f8-45e1-9e73-ac2f7ac3020f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:55.472318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571292e4-f5f8-45e1-9e73-ac2f7ac3020f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:55.472828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571292e4-f5f8-45e1-9e73-ac2f7ac3020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:55.504850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-571292e4-f5f8-45e1-9e73-ac2f7ac3020f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:55.506383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-571292e4-f5f8-45e1-9e73-ac2f7ac3020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:55.569880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:55.597972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 47/99] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:18:55.631687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ac49-d048-427a-a183-e2398fb2a0d0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:55.773374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ac49-d048-427a-a183-e2398fb2a0d0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:55.820353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:55.821041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:55.821325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:55.821632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:55.832733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:55.837777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:55.838600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:18:55.839683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 53/100] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:55.844884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571292e4-f5f8-45e1-9e73-ac2f7ac3020f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:55.990942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571292e4-f5f8-45e1-9e73-ac2f7ac3020f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.041771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a312-6590-4dcd-80dd-cc79e9fcab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:56.042421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a312-6590-4dcd-80dd-cc79e9fcab40 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.042759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a312-6590-4dcd-80dd-cc79e9fcab40 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.043040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a312-6590-4dcd-80dd-cc79e9fcab40 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.043796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a312-6590-4dcd-80dd-cc79e9fcab40 None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:56.044098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a312-6590-4dcd-80dd-cc79e9fcab40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:56.045498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a312-6590-4dcd-80dd-cc79e9fcab40 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:56.059312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 48/101] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:56.065147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:56.120922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44789cd-eb0f-467f-86ef-1f0827dbe85a None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.121558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44789cd-eb0f-467f-86ef-1f0827dbe85a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.122026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44789cd-eb0f-467f-86ef-1f0827dbe85a None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.123603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 49/102] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:18:56.128576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a34537-efe0-4152-b36c-1b0df57ab65d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.129100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a34537-efe0-4152-b36c-1b0df57ab65d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.129572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a34537-efe0-4152-b36c-1b0df57ab65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.148354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e0a34537-efe0-4152-b36c-1b0df57ab65d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:56.149936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e0a34537-efe0-4152-b36c-1b0df57ab65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:56.155978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:56.187636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:56.227285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 50/103] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:18:56.239467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251946a-2621-4a3a-af2b-f50efcda3e82 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.274874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a34537-efe0-4152-b36c-1b0df57ab65d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:56.304433 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090711f3-14cc-4336-8258-4928f78ed06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:56.305028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090711f3-14cc-4336-8258-4928f78ed06b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.305322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090711f3-14cc-4336-8258-4928f78ed06b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.305594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090711f3-14cc-4336-8258-4928f78ed06b None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.312344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090711f3-14cc-4336-8258-4928f78ed06b None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:56.313831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090711f3-14cc-4336-8258-4928f78ed06b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:56.315782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 54/104] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:56 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:56.316948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106215fe-5423-4bee-91c3-bb5fdda3bc6f None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.317230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106215fe-5423-4bee-91c3-bb5fdda3bc6f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.317504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106215fe-5423-4bee-91c3-bb5fdda3bc6f None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.319349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 55/105] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:56.325586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106215fe-5423-4bee-91c3-bb5fdda3bc6f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:56.418409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a34537-efe0-4152-b36c-1b0df57ab65d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.454370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18282b2c-f332-4ae9-aa59-fcdea6fc439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:56.455272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282b2c-f332-4ae9-aa59-fcdea6fc439d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.455725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282b2c-f332-4ae9-aa59-fcdea6fc439d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.456139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282b2c-f332-4ae9-aa59-fcdea6fc439d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.466876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18282b2c-f332-4ae9-aa59-fcdea6fc439d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-18282b2c-f332-4ae9-aa59-fcdea6fc439d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:56.472089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:56.473552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:18:56.474381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:56.476526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 51/106] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:18:56.478375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98a9d4-ce6b-4e33-a5ec-8d6820d66c69 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.478994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98a9d4-ce6b-4e33-a5ec-8d6820d66c69 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.479524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98a9d4-ce6b-4e33-a5ec-8d6820d66c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.480368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106215fe-5423-4bee-91c3-bb5fdda3bc6f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.489970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:56.498747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-eb98a9d4-ce6b-4e33-a5ec-8d6820d66c69 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:56.500328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-eb98a9d4-ce6b-4e33-a5ec-8d6820d66c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:56.517221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fe8ea-63d2-440a-b76e-5afb7ad88863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:56.517876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fe8ea-63d2-440a-b76e-5afb7ad88863 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.518156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fe8ea-63d2-440a-b76e-5afb7ad88863 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.518800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fe8ea-63d2-440a-b76e-5afb7ad88863 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.520095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fe8ea-63d2-440a-b76e-5afb7ad88863 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:56.521602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fe8ea-63d2-440a-b76e-5afb7ad88863 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:56.523337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 56/107] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:56 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:56.524920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552be8c-833d-4220-96a2-d0feeb56f9e2 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.525124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552be8c-833d-4220-96a2-d0feeb56f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.525397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552be8c-833d-4220-96a2-d0feeb56f9e2 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.526694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 57/108] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:56.531569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552be8c-833d-4220-96a2-d0feeb56f9e2 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:56.552001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:56.573054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 52/109] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:56.576317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98a9d4-ce6b-4e33-a5ec-8d6820d66c69 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:56.642750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552be8c-833d-4220-96a2-d0feeb56f9e2 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.677471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecec72-e4f9-4ee9-b27f-384cf1c10ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:56.678060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98a9d4-ce6b-4e33-a5ec-8d6820d66c69 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.678179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecec72-e4f9-4ee9-b27f-384cf1c10ff0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.678366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecec72-e4f9-4ee9-b27f-384cf1c10ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.678640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecec72-e4f9-4ee9-b27f-384cf1c10ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.679363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecec72-e4f9-4ee9-b27f-384cf1c10ff0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:56.679703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecec72-e4f9-4ee9-b27f-384cf1c10ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:56.681178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecec72-e4f9-4ee9-b27f-384cf1c10ff0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:56.690651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 58/110] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:18:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:56.692288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe9c5-1eb3-42f3-8d59-95d185397a3d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.692579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe9c5-1eb3-42f3-8d59-95d185397a3d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.692858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe9c5-1eb3-42f3-8d59-95d185397a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.714420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-58dbe9c5-1eb3-42f3-8d59-95d185397a3d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:56.715639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-58dbe9c5-1eb3-42f3-8d59-95d185397a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:56.726064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:56.726963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.727348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.727789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/8d7618d1e3264e288a59b8636924711f/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.730356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d6dd272094584be1ba22fa4ea9281, user_id=8d7618d1e3264e288a59b8636924711f, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:56.732063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:56.749344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:56.756476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 53/111] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:18:56 2022] PUT /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/8d7618d1e3264e288a59b8636924711f/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:56.759524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:56.794775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:56.801502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 59/112] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:56.802815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbe9c5-1eb3-42f3-8d59-95d185397a3d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:56.929426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d9ee-c047-4fdd-bcf5-f92dcfdd6e51 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.976505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:56.977532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:56.977662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:56.978378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:56.986686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbe9c5-1eb3-42f3-8d59-95d185397a3d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:56.994668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:57.001230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:57.002179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 54/113] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:18:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:57.003575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.036155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320531d6-510a-4c1e-b5e7-ea858c9682fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.036831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320531d6-510a-4c1e-b5e7-ea858c9682fc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.037117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320531d6-510a-4c1e-b5e7-ea858c9682fc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.037820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320531d6-510a-4c1e-b5e7-ea858c9682fc None admin] PATH_INFO: `/v3/users/341e567c2cbd480a9b7017679689f686` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.052736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320531d6-510a-4c1e-b5e7-ea858c9682fc None admin] RBAC: Authorizing `identity:get_user(user_id=341e567c2cbd480a9b7017679689f686)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:57.054222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320531d6-510a-4c1e-b5e7-ea858c9682fc None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:57.056184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 60/114] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:56 2022] GET /identity/v3/users/341e567c2cbd480a9b7017679689f686 => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:57.057212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f54d3-a18a-4650-934e-7f98bfd5ae30 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.057501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f54d3-a18a-4650-934e-7f98bfd5ae30 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.057781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f54d3-a18a-4650-934e-7f98bfd5ae30 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.059111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 61/115] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:57.060872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f54d3-a18a-4650-934e-7f98bfd5ae30 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.093716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.103903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.123812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed7f53-f82b-4363-810c-d7e58f12d04f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.158225 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee200b2d-0045-48ec-8379-4796edce764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.158898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee200b2d-0045-48ec-8379-4796edce764e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.159186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee200b2d-0045-48ec-8379-4796edce764e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.159468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee200b2d-0045-48ec-8379-4796edce764e None admin] PATH_INFO: `/v3/domains/default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.160690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee200b2d-0045-48ec-8379-4796edce764e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:57.162605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee200b2d-0045-48ec-8379-4796edce764e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:57.164286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 55/116] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:57.165472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b6e9-faca-4888-8eca-4d164b579562 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.165763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b6e9-faca-4888-8eca-4d164b579562 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.166043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b6e9-faca-4888-8eca-4d164b579562 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.167385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 56/117] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:57.167978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67b6e9-faca-4888-8eca-4d164b579562 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.178973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f54d3-a18a-4650-934e-7f98bfd5ae30 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.215960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7c255-3e0c-4318-947c-603daaee4f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.216587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c255-3e0c-4318-947c-603daaee4f05 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.216870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c255-3e0c-4318-947c-603daaee4f05 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.217144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c255-3e0c-4318-947c-603daaee4f05 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.218126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7c255-3e0c-4318-947c-603daaee4f05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:57.218126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7c255-3e0c-4318-947c-603daaee4f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:57.219515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7c255-3e0c-4318-947c-603daaee4f05 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:57.232232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 62/118] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:57.233565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0dc5-2e7b-4362-ae26-b0d718bc4c9d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.233849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0dc5-2e7b-4362-ae26-b0d718bc4c9d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.234279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0dc5-2e7b-4362-ae26-b0d718bc4c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.252443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-af8a0dc5-2e7b-4362-ae26-b0d718bc4c9d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:57.253693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-af8a0dc5-2e7b-4362-ae26-b0d718bc4c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:57.274228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67b6e9-faca-4888-8eca-4d164b579562 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.309596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c3fe9-553e-4c8e-b020-47215dc4957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.310238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c3fe9-553e-4c8e-b020-47215dc4957f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.310525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c3fe9-553e-4c8e-b020-47215dc4957f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.310808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c3fe9-553e-4c8e-b020-47215dc4957f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.324689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 63/119] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:57.325744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a0dc5-2e7b-4362-ae26-b0d718bc4c9d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.340944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.355736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.394981 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c3fe9-553e-4c8e-b020-47215dc4957f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:57.396484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c3fe9-553e-4c8e-b020-47215dc4957f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:57.441636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a0dc5-2e7b-4362-ae26-b0d718bc4c9d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.474981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.475533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.475845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.476118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.476793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:57.478371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:57.502056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 57/120] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:18:57.504291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a37b9-f1a2-4f4d-844d-9df213993082 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.504736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a37b9-f1a2-4f4d-844d-9df213993082 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.505166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a37b9-f1a2-4f4d-844d-9df213993082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.505655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 64/121] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:18:57 2022] POST /identity/v3/projects => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:18:57.506493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.529399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-860a37b9-f1a2-4f4d-844d-9df213993082 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:57.531116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-860a37b9-f1a2-4f4d-844d-9df213993082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:57.586806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.590208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.613861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 58/122] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:18:57.615144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a37b9-f1a2-4f4d-844d-9df213993082 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.645070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691e56-3591-49c1-9013-ed1efe72e46a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.695849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.696539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.696928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.697556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.698872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:57.700401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:57.702022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 65/123] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:57.702800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.741163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a37b9-f1a2-4f4d-844d-9df213993082 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.779265 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.779973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.780252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.780522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.791839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:57.798377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:57.799277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:57.800235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:57.800807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 59/124] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:57.801858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.841736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9065a-4915-4cf4-ba56-23d052ebf516 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.846027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.880785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.881892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.882421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.883006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.884510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:57.886348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:57.888335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 66/125] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:57.889412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:57.899376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:57.905565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245acef-b74d-4553-8915-f3c012722240 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:57.959179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:57.959894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:57.960176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:57.960451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:57.975054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:57.981547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:57.982393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:18:57.983154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:18:57.987684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 60/126] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:57.988854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.012207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8a48-bd52-4987-a78e-9cffccd6abea None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.055326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.056351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.056770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.057176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.058495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.060130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.066747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 67/127] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.067748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.125212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:58.128968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed084b-4b79-4009-a89a-fb397ccce448 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.145248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:58.168520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.169119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.169702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.169987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.170747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:58.171055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.171528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c41e6-6491-4184-bdd0-8113fcdb6691 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.172473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.181336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 61/128] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:18:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.182476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.206687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.207541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.207981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.208388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.209406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] RBAC: Adding query filter params (role.id=b349f604875646c88269f9a8664c03b4, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=341e567c2cbd480a9b7017679689f686) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:58.209851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.211443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.217155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 68/129] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:18:58 2022] GET /identity/v3/role_assignments?user.id=341e567c2cbd480a9b7017679689f686&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=b349f604875646c88269f9a8664c03b4 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.218057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.294739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1dc45-c983-425f-9f5a-ade8add8f699 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.323804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebab52-bd9f-499f-9e1a-4c016d7322af None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.333269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.333979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.334269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.334548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.335330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:58.335671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.337286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.347110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 62/130] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.347884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.368830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.369873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.370361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.370823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/8d7618d1e3264e288a59b8636924711f/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.373308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d6dd272094584be1ba22fa4ea9281, user_id=8d7618d1e3264e288a59b8636924711f, role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.375044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.376625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:58.389246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:58.395680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 69/131] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:18:58 2022] PUT /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/8d7618d1e3264e288a59b8636924711f/roles/fdf4549fa310408a94a78961b0a3fabc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:58.397588 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.497878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908946-ab2c-4fd5-a992-0d0b6ae7706f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.574915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.575522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.575807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.576082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.577408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.578858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.580528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 63/132] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:58 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.590051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.613777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0904410-a793-4c76-bb4e-47e3d64da512 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.650461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.651472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.651976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.652462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] PATH_INFO: `/v3/users/aa34501abc84417abc9f42b1fba8ece5` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.653957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] RBAC: Authorizing `identity:get_user(user_id=aa34501abc84417abc9f42b1fba8ece5)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.655600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.657596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 70/133] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:58 2022] GET /identity/v3/users/aa34501abc84417abc9f42b1fba8ece5 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.663188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.708006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:58.719742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48031a-72f5-4386-8ad9-4f0f8fe4a382 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.760429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.761148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.761431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.761716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] PATH_INFO: `/v3/projects/8165d240247d41678ad1cb76e2f288cf` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.767644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] RBAC: Authorizing `identity:get_project(project_id=8165d240247d41678ad1cb76e2f288cf)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.767644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.767644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 64/134] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:58 2022] GET /identity/v3/projects/8165d240247d41678ad1cb76e2f288cf => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.772632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.795193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:58.839731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9e009-b470-40d5-9e6c-af38bb6fddd5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:58.873140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:58.873806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:58.874138 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:58.874425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:58.875815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:58.878156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:58.879963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 71/135] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:18:58 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:58.888418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:58.969734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a83e3f-9f0e-45a9-b46a-811f0ead64bc None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:59.049268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d13be-0609-440c-a0bf-1aa43f704a58 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:59.057085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac063cf7-0528-4034-af17-b22fac06b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:59.057807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac063cf7-0528-4034-af17-b22fac06b61e None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:59.058090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac063cf7-0528-4034-af17-b22fac06b61e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:59.058368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac063cf7-0528-4034-af17-b22fac06b61e None admin] PATH_INFO: `/v3/projects/8165d240247d41678ad1cb76e2f288cf/users/8d7618d1e3264e288a59b8636924711f/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:59.064350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac063cf7-0528-4034-af17-b22fac06b61e None admin] RBAC: Authorizing `identity:create_grant(project_id=8165d240247d41678ad1cb76e2f288cf, user_id=8d7618d1e3264e288a59b8636924711f, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:59.065827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac063cf7-0528-4034-af17-b22fac06b61e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:59.090393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 65/136] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:18:58 2022] PUT /identity/v3/projects/8165d240247d41678ad1cb76e2f288cf/users/8d7618d1e3264e288a59b8636924711f/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:18:59.097142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e4d54-73e4-4f69-aff3-1a67ea46b3f8 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:59.097452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e4d54-73e4-4f69-aff3-1a67ea46b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:59.097701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e4d54-73e4-4f69-aff3-1a67ea46b3f8 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:59.099282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 66/137] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:18:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:18:59.104548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:59.105362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:59.105650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:59.105932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/aa34501abc84417abc9f42b1fba8ece5/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:59.108192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d6dd272094584be1ba22fa4ea9281, user_id=aa34501abc84417abc9f42b1fba8ece5, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:59.109684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:59.112369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:59.114600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bd72f-2a95-43fd-a67b-06311f80c3a8 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:59.114892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bd72f-2a95-43fd-a67b-06311f80c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:59.115171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bd72f-2a95-43fd-a67b-06311f80c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:59.146529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:18:58 2022] PUT /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/aa34501abc84417abc9f42b1fba8ece5/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:59.153065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-281bd72f-2a95-43fd-a67b-06311f80c3a8 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:59.154447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-281bd72f-2a95-43fd-a67b-06311f80c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:59.195560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:59.288523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:18:59.326398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:59.455593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3b1e-49ad-47af-af10-2e221b2c7bb7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:59.498898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:59.499561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:59.499879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:59.500152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:59.517145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:18:59.523254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:18:59.524196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:18:59.525059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 73/140] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:18:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:18:59.532783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bd72f-2a95-43fd-a67b-06311f80c3a8 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:59.718334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bd72f-2a95-43fd-a67b-06311f80c3a8 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:59.766735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:59.767381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:59.767681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:59.767958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:59.768687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:18:59.768992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:59.770375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:59.783166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 68/141] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:18:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:59.789125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:59.874767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:59.929593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5dd0-429e-4eb6-92ba-303ad310f2ad None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:59.967633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6825d35-49dc-4509-a8ec-69b16075c5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:59.968333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825d35-49dc-4509-a8ec-69b16075c5a3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:59.968672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825d35-49dc-4509-a8ec-69b16075c5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:59.968894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825d35-49dc-4509-a8ec-69b16075c5a3 None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:59.970161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6825d35-49dc-4509-a8ec-69b16075c5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:59.971710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6825d35-49dc-4509-a8ec-69b16075c5a3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:59.973778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 74/142] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:18:59 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:18:59.979693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:00.004035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:00.121148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62543a83-5acb-4324-8cdf-87c5b168e9fb None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:00.155227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:00.155899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:00.156181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:00.156453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:00.224535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:00.225194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46196b1-ebc1-4853-9533-0947e8278e27 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:00.225485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46196b1-ebc1-4853-9533-0947e8278e27 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:00.225765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46196b1-ebc1-4853-9533-0947e8278e27 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:00.225931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:00.227300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 75/143] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:00.240109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:00.245153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457343-c3da-47b2-a8ee-902acbd6ea04 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:00.245440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457343-c3da-47b2-a8ee-902acbd6ea04 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:00.245719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457343-c3da-47b2-a8ee-902acbd6ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:00.285343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b9457343-c3da-47b2-a8ee-902acbd6ea04 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:00.286551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b9457343-c3da-47b2-a8ee-902acbd6ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:00.327468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 69/144] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:00.334266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:00.426248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 76/145] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:00.466161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9457343-c3da-47b2-a8ee-902acbd6ea04 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:00.490635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd5e0c-edbb-48ba-9fec-7e8fe104db97 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:00.519998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:00.558291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:00.558961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:00.559245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:00.559518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:00.560369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:00.562854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:00.564570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:00.567711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 70/146] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:00 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:00.575503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:00.658538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9457343-c3da-47b2-a8ee-902acbd6ea04 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:00.717812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:00.718478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:00.718761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:00.719038 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:00.726535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:00.726535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:00.726751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 77/147] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:00.732789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:00.774459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c2ba2-4a34-4377-a333-e9be30d9bee3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:00.852865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250a1c-9dfc-44fb-9b4b-c7cacc0ec1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:00.853857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250a1c-9dfc-44fb-9b4b-c7cacc0ec1a1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:00.854324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250a1c-9dfc-44fb-9b4b-c7cacc0ec1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:00.854781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250a1c-9dfc-44fb-9b4b-c7cacc0ec1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:00.855908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250a1c-9dfc-44fb-9b4b-c7cacc0ec1a1 None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=8d7618d1e3264e288a59b8636924711f) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:00.856418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250a1c-9dfc-44fb-9b4b-c7cacc0ec1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:00.858172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250a1c-9dfc-44fb-9b4b-c7cacc0ec1a1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:00.873003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 71/148] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:00 2022] GET /identity/v3/role_assignments?user.id=8d7618d1e3264e288a59b8636924711f&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:00.883588 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d859e30-ac40-4362-ab6b-ea46f66c6893 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:00.913672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:00.928108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f7c34-e822-4b4c-837d-6d4265f48912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:00.928746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f7c34-e822-4b4c-837d-6d4265f48912 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:00.929025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f7c34-e822-4b4c-837d-6d4265f48912 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:00.929297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f7c34-e822-4b4c-837d-6d4265f48912 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:00.929994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f7c34-e822-4b4c-837d-6d4265f48912 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:00.931595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f7c34-e822-4b4c-837d-6d4265f48912 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:00.969181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 78/149] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:00 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:19:01.284525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0cfe4-e9d1-45c7-bdfc-9d438f19cc91 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.285195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0cfe4-e9d1-45c7-bdfc-9d438f19cc91 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.285687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0cfe4-e9d1-45c7-bdfc-9d438f19cc91 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.287283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 72/150] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:01.293610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc5cd-aece-4be9-b9ea-f2a8a7003093 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.293897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc5cd-aece-4be9-b9ea-f2a8a7003093 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.294174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc5cd-aece-4be9-b9ea-f2a8a7003093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.295602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a08d-38e5-43b7-a902-3346ef1129b3 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.296161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a08d-38e5-43b7-a902-3346ef1129b3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.296626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a08d-38e5-43b7-a902-3346ef1129b3 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.298146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 73/151] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:01.303886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a8d3-ccf0-4a07-89d7-d4c977e41f9f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.304515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a8d3-ccf0-4a07-89d7-d4c977e41f9f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.305005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a8d3-ccf0-4a07-89d7-d4c977e41f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.320504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-0f5dc5cd-aece-4be9-b9ea-f2a8a7003093 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:01.321758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0f5dc5cd-aece-4be9-b9ea-f2a8a7003093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:01.330231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ff34a8d3-ccf0-4a07-89d7-d4c977e41f9f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:01.331765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ff34a8d3-ccf0-4a07-89d7-d4c977e41f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:01.391241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:01.416700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 79/152] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:01.437424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 74/153] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:01.443563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc5cd-aece-4be9-b9ea-f2a8a7003093 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:01.467700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34a8d3-ccf0-4a07-89d7-d4c977e41f9f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:01.574110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc5cd-aece-4be9-b9ea-f2a8a7003093 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:01.583159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:01.609636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34a8d3-ccf0-4a07-89d7-d4c977e41f9f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:01.625407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:01.626079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.626357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.628184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.642681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:01.648271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:01.649137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:01.650007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 80/154] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:01.654607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:01.655287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.655564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.655856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:01.656031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.669810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:01.674719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:01.676846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:01.678937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 75/155] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:01.684139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:01.725063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:01.773508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90b74e-29fd-4a06-b1c9-08f9c7265974 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:01.793230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5045ba-c1e6-4369-ae48-639c58ec0a60 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:01.811020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:01.811809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.812090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.812362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.813082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:01.813381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:01.814987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:01.825025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 81/156] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:01.830495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:01.831199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:01.831866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:01.832167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:01.832399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:01.833117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:01.833415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:01.834816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:01.844010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 76/157] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:01.849828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:01.869005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:01.949452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:01.955282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e8c0c-f581-475d-8914-eb15a4921c42 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:01.984972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72092aa-d12a-4210-91e0-dd93ef2db0a1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:01.999412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:02.000092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.000374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.000646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.001837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:02.003360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:02.005164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 77/158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:01 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:02.011802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:02.071009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:02.073918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.074195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.074470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] PATH_INFO: `/v3/users/341e567c2cbd480a9b7017679689f686` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.076905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] RBAC: Authorizing `identity:get_user(user_id=341e567c2cbd480a9b7017679689f686)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:02.080719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:02.083499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 82/159] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:01 2022] GET /identity/v3/users/341e567c2cbd480a9b7017679689f686 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:02.091747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:02.178377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf038ef-73a8-4d37-be5b-30ac9cd2dc91 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:02.233510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebc3fd-1451-457a-bd62-6e85da9e7ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:02.234435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc3fd-1451-457a-bd62-6e85da9e7ba7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.235576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc3fd-1451-457a-bd62-6e85da9e7ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.236031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc3fd-1451-457a-bd62-6e85da9e7ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.291039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:02.293110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:02.302194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7086-bee3-4f9b-a20d-7b3ceebfb783 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:02.356008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebc3fd-1451-457a-bd62-6e85da9e7ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:02.357408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebc3fd-1451-457a-bd62-6e85da9e7ba7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:02.362529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b351a-93b8-4760-88ea-32446701cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:02.363229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b351a-93b8-4760-88ea-32446701cf59 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.363510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b351a-93b8-4760-88ea-32446701cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.364498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b351a-93b8-4760-88ea-32446701cf59 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.365685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b351a-93b8-4760-88ea-32446701cf59 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:02.367149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b351a-93b8-4760-88ea-32446701cf59 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:02.368939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 83/160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:02 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:02.374840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344697a-9f5c-47cf-b34b-4a853f822c44 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.375123 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344697a-9f5c-47cf-b34b-4a853f822c44 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.375397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344697a-9f5c-47cf-b34b-4a853f822c44 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.376858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 84/161] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:02.377825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344697a-9f5c-47cf-b34b-4a853f822c44 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:02.515981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344697a-9f5c-47cf-b34b-4a853f822c44 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:02.557236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f22a6-0453-46e0-b1d5-ed3a441e6552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:02.557979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f22a6-0453-46e0-b1d5-ed3a441e6552 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.558213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f22a6-0453-46e0-b1d5-ed3a441e6552 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.558485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f22a6-0453-46e0-b1d5-ed3a441e6552 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/341e567c2cbd480a9b7017679689f686/roles/b349f604875646c88269f9a8664c03b4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.561826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f22a6-0453-46e0-b1d5-ed3a441e6552 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d6dd272094584be1ba22fa4ea9281, user_id=341e567c2cbd480a9b7017679689f686, role_id=b349f604875646c88269f9a8664c03b4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:02.563301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f22a6-0453-46e0-b1d5-ed3a441e6552 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:02.575370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 78/162] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:02.576708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84e6a-fe18-4c49-ae84-019434dea5e0 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.576995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84e6a-fe18-4c49-ae84-019434dea5e0 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.577271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84e6a-fe18-4c49-ae84-019434dea5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.598074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 85/163] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:02 2022] PUT /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/users/341e567c2cbd480a9b7017679689f686/roles/b349f604875646c88269f9a8664c03b4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:02.600031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c49d-8404-4e6c-b4d7-2f21da31a8b5 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.600424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c49d-8404-4e6c-b4d7-2f21da31a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.600866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c49d-8404-4e6c-b4d7-2f21da31a8b5 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.602991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 86/164] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:02.603655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091c49d-8404-4e6c-b4d7-2f21da31a8b5 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:02.609091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1bf84e6a-fe18-4c49-ae84-019434dea5e0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:02.610245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1bf84e6a-fe18-4c49-ae84-019434dea5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:02.659864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:02.738183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:02.755402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 79/165] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:02.757122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496a7f1-2e0f-4262-a7e3-f4e3ad3b1eee None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.757407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496a7f1-2e0f-4262-a7e3-f4e3ad3b1eee None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.757682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496a7f1-2e0f-4262-a7e3-f4e3ad3b1eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.793338 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d496a7f1-2e0f-4262-a7e3-f4e3ad3b1eee None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:02.794713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d496a7f1-2e0f-4262-a7e3-f4e3ad3b1eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:02.808965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091c49d-8404-4e6c-b4d7-2f21da31a8b5 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:02.871836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:02.872403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:02.872679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:02.872954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:02.874129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:02.875599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:02.878279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 87/166] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:02 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:02.879205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:02.922973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 80/167] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:02.924925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496a7f1-2e0f-4262-a7e3-f4e3ad3b1eee None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:03.093408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496a7f1-2e0f-4262-a7e3-f4e3ad3b1eee None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:03.126076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:03.145786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:03.146433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:03.147181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:03.147460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:03.148283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] RBAC: Adding query filter params (role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=8d7618d1e3264e288a59b8636924711f) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:03.148589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:03.150275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:03.156846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 81/168] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:02 2022] GET /identity/v3/role_assignments?user.id=8d7618d1e3264e288a59b8636924711f&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:03.162792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:03.172004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:03.222683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc747c-faa4-4df1-a962-35f4c5dd2022 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:03.309561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30205659-e73e-4f5d-be77-a1235d2afe26 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:03.354342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:03.355074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:03.355364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:03.355650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:03.373664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:03.379274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:03.380355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:03.381122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:03.381741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:03.381741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:03.381741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:03.381741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:03.384742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 82/169] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:03.390649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:03.444328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:03.450446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:03.452181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:03.453166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 88/170] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 573 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:03.473131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:03.476679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:03.554517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565bfad-a0ba-4ed1-9307-b65a29d48528 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:03.606016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:03.606658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:03.606936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:03.607211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:03.607962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:03.608270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:03.610223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:03.619090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 83/171] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:03.626650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:03.783879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1338915-08f2-4d48-b0fb-a37e0e02d6fb None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:03.802406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:03.840413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:03.841086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:03.841361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:03.841630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] PATH_INFO: `/v3/users/aa34501abc84417abc9f42b1fba8ece5` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:03.845763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] RBAC: Authorizing `identity:get_user(user_id=aa34501abc84417abc9f42b1fba8ece5)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:03.847259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:03.849207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 84/172] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:03 2022] GET /identity/v3/users/aa34501abc84417abc9f42b1fba8ece5 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:03.855068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:03.857027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbf832-f7de-4f04-97b5-79a260f570d7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:03.995985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea39a-aa0b-4f5b-8b53-3313ae9bab9a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:04.016334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:04.016992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:04.017277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:04.017555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:04.018288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:04.018594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:04.020019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:04.038348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 89/173] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:04.044709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:04.085681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:04.112907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0580ff-cd9b-4e4f-9cea-dc9d7403fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:04.113563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0580ff-cd9b-4e4f-9cea-dc9d7403fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:04.113850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0580ff-cd9b-4e4f-9cea-dc9d7403fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:04.114130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0580ff-cd9b-4e4f-9cea-dc9d7403fcc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:04.180974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e432-afe8-47d8-9512-cc9eae056ab9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:04.215493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:04.216173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:04.216453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:04.216727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] PATH_INFO: `/v3/users/8d7618d1e3264e288a59b8636924711f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:04.217917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] RBAC: Authorizing `identity:get_user(user_id=8d7618d1e3264e288a59b8636924711f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:04.219394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:04.221073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 90/174] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:04 2022] GET /identity/v3/users/8d7618d1e3264e288a59b8636924711f => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:04.226106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:04.227562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:04.259990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0580ff-cd9b-4e4f-9cea-dc9d7403fcc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:04.261476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0580ff-cd9b-4e4f-9cea-dc9d7403fcc6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:04.396123 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:04.422466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 85/175] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 06:19:04.429138 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06785c-1a78-4520-9b0f-c91fabe110cd None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:04.432082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e09b3-ceb1-43be-9b5a-a4ace31f4319 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:04.432384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e09b3-ceb1-43be-9b5a-a4ace31f4319 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:04.432662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e09b3-ceb1-43be-9b5a-a4ace31f4319 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:04.434086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 86/176] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:04.441853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549a5ae-b851-400d-b977-661ac49c8634 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:04.442130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549a5ae-b851-400d-b977-661ac49c8634 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:04.442412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549a5ae-b851-400d-b977-661ac49c8634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:04.480229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6549a5ae-b851-400d-b977-661ac49c8634 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:04.481438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6549a5ae-b851-400d-b977-661ac49c8634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:04.503053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:04.504200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:04.504777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:04.505337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:04.627680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 87/177] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:04.628572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549a5ae-b851-400d-b977-661ac49c8634 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:04.644806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:04.651505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:04.652981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:04.763991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549a5ae-b851-400d-b977-661ac49c8634 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:04.811698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:04.813241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:04.813743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:04.814210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:04.815665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:04.817317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:04.822773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 88/178] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:04 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:04.824461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:04.836144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:04.875210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 91/179] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:04.876119 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:04.990627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.057671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe661-7cb0-4cc0-81d3-9e5aea591679 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.071829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffe1fa-ec20-4d43-9b9f-4054d879a832 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.096714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.097818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.098104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.098703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.099916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=aa34501abc84417abc9f42b1fba8ece5) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:05.100232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:05.102153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:05.109254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b51801-25fa-407f-8dee-09ca2014b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.109925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b51801-25fa-407f-8dee-09ca2014b374 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.110022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 92/180] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:04 2022] GET /identity/v3/role_assignments?user.id=aa34501abc84417abc9f42b1fba8ece5&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:05.110208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b51801-25fa-407f-8dee-09ca2014b374 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.110484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b51801-25fa-407f-8dee-09ca2014b374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.110974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.153479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b51801-25fa-407f-8dee-09ca2014b374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-f3b51801-25fa-407f-8dee-09ca2014b374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:05.161186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:05.162144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:05.162912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 89/181] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:05.164103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9a9c9-e313-45ea-8859-e03c41671809 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.164103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9a9c9-e313-45ea-8859-e03c41671809 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.164347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9a9c9-e313-45ea-8859-e03c41671809 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.169177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 90/182] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:05.169177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60859b-a04c-4614-8363-ac1090b2543a None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.169177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60859b-a04c-4614-8363-ac1090b2543a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.169177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60859b-a04c-4614-8363-ac1090b2543a None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.170199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 91/183] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:05.171094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60859b-a04c-4614-8363-ac1090b2543a None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.181549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.250656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70a43-a96b-4f4e-a3cb-9de8bcfd1240 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.292260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a0762-cbe0-49d0-beb8-94f2f5489b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.293029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a0762-cbe0-49d0-beb8-94f2f5489b83 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.293375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a0762-cbe0-49d0-beb8-94f2f5489b83 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.293717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a0762-cbe0-49d0-beb8-94f2f5489b83 None admin] PATH_INFO: `/v3/projects/8165d240247d41678ad1cb76e2f288cf` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.295229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a0762-cbe0-49d0-beb8-94f2f5489b83 None admin] RBAC: Authorizing `identity:get_project(project_id=8165d240247d41678ad1cb76e2f288cf)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:05.296989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a0762-cbe0-49d0-beb8-94f2f5489b83 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:05.304071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 93/184] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/projects/8165d240247d41678ad1cb76e2f288cf => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:05.306087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411736-8177-40ff-aea3-da3284d9e262 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.306582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411736-8177-40ff-aea3-da3284d9e262 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.306936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411736-8177-40ff-aea3-da3284d9e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.314646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60859b-a04c-4614-8363-ac1090b2543a None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.327881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ca411736-8177-40ff-aea3-da3284d9e262 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:05.329363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ca411736-8177-40ff-aea3-da3284d9e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:05.361538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaa5c5-c263-4c82-87fc-64072476eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.362176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa5c5-c263-4c82-87fc-64072476eec0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.363424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa5c5-c263-4c82-87fc-64072476eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.363424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa5c5-c263-4c82-87fc-64072476eec0 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.363424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaa5c5-c263-4c82-87fc-64072476eec0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:05.364642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaa5c5-c263-4c82-87fc-64072476eec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:05.365958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaa5c5-c263-4c82-87fc-64072476eec0 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:05.369013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.378806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 92/185] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:05.380108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a209-bf6b-43ac-81e9-0dccd88697c5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.380395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a209-bf6b-43ac-81e9-0dccd88697c5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.380669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a209-bf6b-43ac-81e9-0dccd88697c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.400055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-c6d5a209-bf6b-43ac-81e9-0dccd88697c5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:05.401530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c6d5a209-bf6b-43ac-81e9-0dccd88697c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:05.409414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 94/186] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:05.411477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411736-8177-40ff-aea3-da3284d9e262 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.457930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.473927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 93/187] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:05.475198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fabaa-ee4b-4fc3-8f83-78300ca81401 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.475480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fabaa-ee4b-4fc3-8f83-78300ca81401 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.475787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fabaa-ee4b-4fc3-8f83-78300ca81401 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.477008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 94/188] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:05.477721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fabaa-ee4b-4fc3-8f83-78300ca81401 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.519199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411736-8177-40ff-aea3-da3284d9e262 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.553364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.553985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.554263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.554536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.555324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=8165d240247d41678ad1cb76e2f288cf, user.id=8d7618d1e3264e288a59b8636924711f) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:05.555645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:05.557191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:05.563139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 95/189] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/role_assignments?user.id=8d7618d1e3264e288a59b8636924711f&scope.project.id=8165d240247d41678ad1cb76e2f288cf&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:05.563943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.587785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fabaa-ee4b-4fc3-8f83-78300ca81401 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.617575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.627271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb9b1f-1038-49b0-bd26-9b210dc600a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.627978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9b1f-1038-49b0-bd26-9b210dc600a6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.628253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9b1f-1038-49b0-bd26-9b210dc600a6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.628538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9b1f-1038-49b0-bd26-9b210dc600a6 None admin] PATH_INFO: `/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.646795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb9b1f-1038-49b0-bd26-9b210dc600a6 None admin] RBAC: Authorizing `identity:get_user(user_id=7fb480cdcd4e4daebfe7c50446cd6f85)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:05.648335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb9b1f-1038-49b0-bd26-9b210dc600a6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:05.650161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 95/190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:05.651401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240a62b-1117-41b5-808a-9112f1c25035 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.651722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240a62b-1117-41b5-808a-9112f1c25035 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.652000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240a62b-1117-41b5-808a-9112f1c25035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.671192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1240a62b-1117-41b5-808a-9112f1c25035 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:05.672447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1240a62b-1117-41b5-808a-9112f1c25035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:05.681185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d72b3-6d32-43e0-a8f0-89e244d1131e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.692257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.723383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.724459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.724880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.725160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.740471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:05.746902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:05.747930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:05.748943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 96/191] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:05.749631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.754921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 96/192] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:05.757378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240a62b-1117-41b5-808a-9112f1c25035 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.861070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ad83-4f9f-4fc5-8344-deb06edc899f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.864239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240a62b-1117-41b5-808a-9112f1c25035 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:05.881895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.894393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.895058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.895344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.895596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.896764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:05.898233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:05.899890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 97/193] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:05.900269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:05.900905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:05.901257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:05.901530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:05.904752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:05.940771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:05.967991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:05.969439 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.006284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49078b-49d7-4c20-8a0c-cdbc4fa3ddb9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.043320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.043983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.044242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.044514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.045228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:06.045527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.046914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.054888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 98/194] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:06.055495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.073858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 97/195] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:06.074695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.093363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:06.152235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:06.156358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669346e-6db2-41ff-9891-1ce14b37f4b5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.174394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d4df-e09f-498e-b914-fa9b05dc864f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.188037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.188720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.188988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.189258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.199904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:06.205406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:06.206278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 99/196] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:06.207067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.214810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.215877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.216166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.216446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.217134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.219273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.241003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 98/197] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:06 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:06.242136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.330409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:06.331980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d6b8-28e3-4885-acf2-06130782b014 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.367142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd35b5-d528-43e8-b345-adcb9f949d04 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.371021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.371733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.372019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.372293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] PATH_INFO: `/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.373583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] RBAC: Authorizing `identity:get_user(user_id=7fb480cdcd4e4daebfe7c50446cd6f85)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.375080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.377393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 100/198] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:06.378222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.408909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.409506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.409807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.410087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.411322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.412828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.414516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 99/199] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:06.415374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.421813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:06.520765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e9868-e8ef-408a-975f-66acea153325 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.540809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd0e26-db46-432a-9f9c-c48f2328c96a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.562479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81648108-a244-4326-94a2-6e34543d137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.563118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648108-a244-4326-94a2-6e34543d137f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.563403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648108-a244-4326-94a2-6e34543d137f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.564312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648108-a244-4326-94a2-6e34543d137f None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.564480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81648108-a244-4326-94a2-6e34543d137f None admin] RBAC: Adding query filter params (name=reader) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:06.564793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81648108-a244-4326-94a2-6e34543d137f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.566210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81648108-a244-4326-94a2-6e34543d137f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.576031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 101/200] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:06.576798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81648108-a244-4326-94a2-6e34543d137f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.583193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.584150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.584645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.585123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.598411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:06.675223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.677484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.695086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81648108-a244-4326-94a2-6e34543d137f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.712316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:06.738048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.738907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.739352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.739833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.740912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=7fb480cdcd4e4daebfe7c50446cd6f85) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:06.741355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.742943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.749357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 102/201] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/role_assignments?user.id=7fb480cdcd4e4daebfe7c50446cd6f85&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:06.756339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.802878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 100/202] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:06.809079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:06.863996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:06.922055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252634-a5c5-45b7-b738-2940579d47a6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.940230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c7634-7072-4a90-aa5e-1d12060a881d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:06.958986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:06.959804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:06.960086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:06.960431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:06.961568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:06.963517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:06.965761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 101/203] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:06.971780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:07.037195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:07.037932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:07.038214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:07.038487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] PATH_INFO: `/v3/users/341e567c2cbd480a9b7017679689f686` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:07.039759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] RBAC: Authorizing `identity:get_user(user_id=341e567c2cbd480a9b7017679689f686)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:07.041288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:07.042959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 103/204] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/users/341e567c2cbd480a9b7017679689f686 => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:07.052670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:07.080333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e17d-6a7a-4ce5-bce9-3636c6f1a098 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:07.091998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:07.117206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:07.117855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:07.118136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:07.118496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:07.119513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] RBAC: Adding query filter params (role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=7fb480cdcd4e4daebfe7c50446cd6f85) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:07.119863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:07.121339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:07.122865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:07.128380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 102/205] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:06 2022] GET /identity/v3/role_assignments?user.id=7fb480cdcd4e4daebfe7c50446cd6f85&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:07.263267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379d496-513d-4953-b658-2e46d61f3b0a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:07.298624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:07.299264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:07.299542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:07.299846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:07.368705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:07.370176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:07.390598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:07.468512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 104/206] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:07.474545 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:07.578318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b69f0-edd6-4aea-9ec4-f1576268e0b1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:07.613438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38725-fa59-4783-94b4-972721186561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:07.614130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38725-fa59-4783-94b4-972721186561 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:07.614416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38725-fa59-4783-94b4-972721186561 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:07.614694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38725-fa59-4783-94b4-972721186561 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:07.615993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f38725-fa59-4783-94b4-972721186561 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:07.617495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f38725-fa59-4783-94b4-972721186561 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:07.619344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 103/207] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:07 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:07.625358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:07.759217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66a13-e7d7-4fe3-9d98-cd4daf7c10a5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:07.782674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:07.798753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c81f0-4b6d-47eb-90f5-2edf9a090fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:07.799889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c81f0-4b6d-47eb-90f5-2edf9a090fef None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:07.800389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c81f0-4b6d-47eb-90f5-2edf9a090fef None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:07.800858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c81f0-4b6d-47eb-90f5-2edf9a090fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:07.801832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c81f0-4b6d-47eb-90f5-2edf9a090fef None admin] RBAC: Adding query filter params (role.id=b349f604875646c88269f9a8664c03b4, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281, user.id=341e567c2cbd480a9b7017679689f686) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:07.802328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c81f0-4b6d-47eb-90f5-2edf9a090fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:07.803980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c81f0-4b6d-47eb-90f5-2edf9a090fef None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:07.810702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 105/208] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:07 2022] GET /identity/v3/role_assignments?user.id=341e567c2cbd480a9b7017679689f686&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=b349f604875646c88269f9a8664c03b4 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:08.640059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4768-3bae-40ae-8a8b-d57709fb87e3 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:08.640625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4768-3bae-40ae-8a8b-d57709fb87e3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:08.640625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4768-3bae-40ae-8a8b-d57709fb87e3 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:08.642357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 104/209] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:08.649636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabde36-1186-4ace-9e6b-4978764ff40f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:08.650587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabde36-1186-4ace-9e6b-4978764ff40f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:08.651053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabde36-1186-4ace-9e6b-4978764ff40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:08.662271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4617-7496-47a4-9b22-008c5cc82861 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:08.662557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4617-7496-47a4-9b22-008c5cc82861 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:08.662835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4617-7496-47a4-9b22-008c5cc82861 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:08.664273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 105/210] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:08.671190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c600ac0-8b25-4272-b628-63427b3d92eb None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:08.671735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c600ac0-8b25-4272-b628-63427b3d92eb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:08.672204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c600ac0-8b25-4272-b628-63427b3d92eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:08.673565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-dcabde36-1186-4ace-9e6b-4978764ff40f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:08.674770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dcabde36-1186-4ace-9e6b-4978764ff40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:08.691843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7c600ac0-8b25-4272-b628-63427b3d92eb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:08.693349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7c600ac0-8b25-4272-b628-63427b3d92eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:08.731304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:08.766141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 106/211] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:08.773702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 106/212] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:08.792584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabde36-1186-4ace-9e6b-4978764ff40f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:08.796826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c600ac0-8b25-4272-b628-63427b3d92eb None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:08.904071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c600ac0-8b25-4272-b628-63427b3d92eb None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:08.920478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabde36-1186-4ace-9e6b-4978764ff40f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:08.937916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:08.942406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:08.943712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:08.944198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:08.945485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:08.957594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:08.960752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:08.961522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:08.961864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:08.962256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:08.963469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:08.963939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:08.964812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:08.965612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:08.966202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:08.968173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 107/214] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:08.972086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 107/214] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:08.973540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:08.976945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.005319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:09.084745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b2702-c8f8-4309-ade2-f48f72a740d0 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.111542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa1374-2b79-4919-9663-f04e62d84f5e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.120306 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ea88d-9afc-43ad-9faa-c227832a1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.120935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea88d-9afc-43ad-9faa-c227832a1470 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.121210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea88d-9afc-43ad-9faa-c227832a1470 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.121480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea88d-9afc-43ad-9faa-c227832a1470 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.122176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ea88d-9afc-43ad-9faa-c227832a1470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:09.123641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ea88d-9afc-43ad-9faa-c227832a1470 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:09.155730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 108/215] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:08 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:19:09.155730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67714d7-3b06-4b8e-adaa-3fce47435a46 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.155730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67714d7-3b06-4b8e-adaa-3fce47435a46 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.155730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67714d7-3b06-4b8e-adaa-3fce47435a46 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.155730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 109/216] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:09.158546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1cbfa-8d6a-4276-bd8c-6a8bef1cf151 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.158829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1cbfa-8d6a-4276-bd8c-6a8bef1cf151 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.159104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1cbfa-8d6a-4276-bd8c-6a8bef1cf151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.161240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.162392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.162755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.162995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.163838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:09.164150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:09.165982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:09.178648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-bda1cbfa-8d6a-4276-bd8c-6a8bef1cf151 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:09.179903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bda1cbfa-8d6a-4276-bd8c-6a8bef1cf151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:09.183431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 108/217] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:09.186049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.242522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:09.254700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 110/218] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:09.277307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1cbfa-8d6a-4276-bd8c-6a8bef1cf151 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.314334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:09.321550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aa282-e897-493e-98b0-1e19580841ed None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.363057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.363753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.364432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.364720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] PATH_INFO: `/v3/users/8ffb605506f24717a2573780f964a465` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.383902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] RBAC: Authorizing `identity:get_user(user_id=8ffb605506f24717a2573780f964a465)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:09.385465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:09.387193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 109/219] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/users/8ffb605506f24717a2573780f964a465 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:09.394769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1cbfa-8d6a-4276-bd8c-6a8bef1cf151 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.395282 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.440412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.440997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.441271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.441536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.461803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:09.466809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:09.467709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:09.468992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 111/220] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:09.479438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.525624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bff9c-2662-4b46-9ddf-1aa954b961fb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.527233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:09.573570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533d5ee-aa14-425a-9fb4-efc264c91218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.574222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d5ee-aa14-425a-9fb4-efc264c91218 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.574504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d5ee-aa14-425a-9fb4-efc264c91218 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.574779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d5ee-aa14-425a-9fb4-efc264c91218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.588060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:09.628177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544119e-708c-4782-b811-3b4bd2677693 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.662613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533d5ee-aa14-425a-9fb4-efc264c91218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:09.664836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533d5ee-aa14-425a-9fb4-efc264c91218 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:09.678898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1125f40-ac57-4812-9158-4c0c6ea9a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.679537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125f40-ac57-4812-9158-4c0c6ea9a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.679855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125f40-ac57-4812-9158-4c0c6ea9a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.680146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125f40-ac57-4812-9158-4c0c6ea9a1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.681193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125f40-ac57-4812-9158-4c0c6ea9a1e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:09.681556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125f40-ac57-4812-9158-4c0c6ea9a1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:09.683434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125f40-ac57-4812-9158-4c0c6ea9a1e0 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:09.695449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 112/221] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:09.701762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b7cf0-633b-43bc-b0b4-6022d1156f53 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.702046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b7cf0-633b-43bc-b0b4-6022d1156f53 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.702317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b7cf0-633b-43bc-b0b4-6022d1156f53 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.703830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 113/222] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:09.704379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b7cf0-633b-43bc-b0b4-6022d1156f53 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.789089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 110/223] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:09.789089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0b72b-20c6-4e0f-8ce5-ef90f28df2a2 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.789089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0b72b-20c6-4e0f-8ce5-ef90f28df2a2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.789089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0b72b-20c6-4e0f-8ce5-ef90f28df2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.793570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:09.807597 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-83f0b72b-20c6-4e0f-8ce5-ef90f28df2a2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:09.808823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-83f0b72b-20c6-4e0f-8ce5-ef90f28df2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:09.848122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b7cf0-633b-43bc-b0b4-6022d1156f53 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.887712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 111/224] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:09.888646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0b72b-20c6-4e0f-8ce5-ef90f28df2a2 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.898725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.899451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.899866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.901970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] PATH_INFO: `/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.901970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] RBAC: Authorizing `identity:get_user(user_id=7fb480cdcd4e4daebfe7c50446cd6f85)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:09.902919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:09.904788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 114/225] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:09.905570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.918739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:10.014133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0b72b-20c6-4e0f-8ce5-ef90f28df2a2 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.025230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35efe-fad3-4fc7-a661-3a363ca141aa None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.050732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:10.057521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.058186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.058469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.058747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.060056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.061733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:10.062827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.063596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 112/226] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:10.064226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.064706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.065169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.069145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:10.077219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:10.082927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:10.083804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:10.084602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:10.091831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 115/227] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:10.093081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:10.160978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:10.175551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6752-6cf4-4604-b5da-191db357743e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.199289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af096fef-cc75-4ab2-83d7-cc16f9fb54b6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.211418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.212171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.212455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.212733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.213918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.215382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:10.217261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 113/228] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:10 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:10.222591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:10.236866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.237877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.238362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.238819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.239838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=8ffb605506f24717a2573780f964a465) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:10.240396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.242033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:10.248008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 116/229] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:10 2022] GET /identity/v3/role_assignments?user.id=8ffb605506f24717a2573780f964a465&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:10.248964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:10.328412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:10.354746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f129-5438-4667-8e66-ef99e156f71f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.416527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.417138 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.417424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.417702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.418451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:10.418756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.420237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:10.433418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 114/230] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:10.439188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:10.458683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71062674-08b7-40aa-9565-84a6cabd826c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.488781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:10.505752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.507006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.507941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.508660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1/users/7fb480cdcd4e4daebfe7c50446cd6f85/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.513844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] RBAC: Authorizing `identity:create_grant(project_id=d76132606c2f4c478b357eba945315f1, user_id=7fb480cdcd4e4daebfe7c50446cd6f85, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.516905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:10.541905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 117/231] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:10 2022] PUT /identity/v3/projects/d76132606c2f4c478b357eba945315f1/users/7fb480cdcd4e4daebfe7c50446cd6f85/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:10.598206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658956-ec63-4689-b14d-b29feb468820 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.641999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:10.650485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.651508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.652003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.652466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] PATH_INFO: `/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.655144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] RBAC: Authorizing `identity:get_user(user_id=7fb480cdcd4e4daebfe7c50446cd6f85)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.657122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:10.659060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 115/232] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:10 2022] GET /identity/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:10.665226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:10.785797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c36d4-c782-4898-9f83-2a7354f7461f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.822939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fa3b-d2a7-488a-a793-d706754fb9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.823993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fa3b-d2a7-488a-a793-d706754fb9be None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.824463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fa3b-d2a7-488a-a793-d706754fb9be None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.824926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fa3b-d2a7-488a-a793-d706754fb9be None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.826318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fa3b-d2a7-488a-a793-d706754fb9be None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.827994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fa3b-d2a7-488a-a793-d706754fb9be None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:10.829874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 118/233] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:10 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:10.836059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:10.946119 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2377a-c887-4992-96e6-d0a3218834a9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:10.990176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5be5d-8126-4e64-9597-a3421278301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:10.991273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5be5d-8126-4e64-9597-a3421278301a None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:10.991787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5be5d-8126-4e64-9597-a3421278301a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:10.992250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5be5d-8126-4e64-9597-a3421278301a None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1/users/7fb480cdcd4e4daebfe7c50446cd6f85/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:10.996636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5be5d-8126-4e64-9597-a3421278301a None admin] RBAC: Authorizing `identity:create_grant(project_id=d76132606c2f4c478b357eba945315f1, user_id=7fb480cdcd4e4daebfe7c50446cd6f85, role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:10.998304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5be5d-8126-4e64-9597-a3421278301a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:11.043650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 116/234] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:10 2022] PUT /identity/v3/projects/d76132606c2f4c478b357eba945315f1/users/7fb480cdcd4e4daebfe7c50446cd6f85/roles/fdf4549fa310408a94a78961b0a3fabc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:11.597884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9cf9-3b2e-49e5-a6f8-e38928c1fd96 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:11.598573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9cf9-3b2e-49e5-a6f8-e38928c1fd96 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:11.599050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9cf9-3b2e-49e5-a6f8-e38928c1fd96 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:11.601018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 119/235] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:11.606101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad6dc-15da-4764-bcc1-8abee09e9b09 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:11.606612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad6dc-15da-4764-bcc1-8abee09e9b09 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:11.607075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad6dc-15da-4764-bcc1-8abee09e9b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:11.618941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acc9f9-3f92-4ada-8aa3-0d9974d1f2bc None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:11.619538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acc9f9-3f92-4ada-8aa3-0d9974d1f2bc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:11.620063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acc9f9-3f92-4ada-8aa3-0d9974d1f2bc None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:11.621616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 120/236] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:11.626782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8988-4bc9-4766-8c8e-1c47afc55eec None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:11.627308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8988-4bc9-4766-8c8e-1c47afc55eec None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:11.627811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8988-4bc9-4766-8c8e-1c47afc55eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:11.647199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-757ad6dc-15da-4764-bcc1-8abee09e9b09 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:11.650416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-757ad6dc-15da-4764-bcc1-8abee09e9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:11.656992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f1cf8988-4bc9-4766-8c8e-1c47afc55eec None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:11.659910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f1cf8988-4bc9-4766-8c8e-1c47afc55eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:11.728040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:11.739220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 121/237] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:11.767437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf8988-4bc9-4766-8c8e-1c47afc55eec None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:11.780010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:11.818305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 117/238] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:11.854064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ad6dc-15da-4764-bcc1-8abee09e9b09 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:11.874431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf8988-4bc9-4766-8c8e-1c47afc55eec None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:11.912302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:11.913256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:11.913542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:11.913816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:11.924888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:11.930034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:11.930905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:11.931722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 122/239] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:11.937131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:11.999368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:12.065672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64b0d-a336-4da9-a7bc-dc4b35051fca None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:12.117343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ad6dc-15da-4764-bcc1-8abee09e9b09 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:12.138213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:12.138848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:12.139130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:12.139403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:12.140153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:12.140457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:12.141868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:12.164392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 123/240] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:12.168438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:12.190371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:12.191412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:12.191916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:12.192395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:12.195808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:12.198313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:12.200368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 118/241] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:12.205835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:12.274173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80f460-9e16-4511-bcc6-a5c4c0c4de27 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:12.288218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:12.309884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:12.310550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:12.310833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:12.311114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] PATH_INFO: `/v3/users/8c069df1d9354277b0629215bcb35004` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:12.318299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:12.334915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] RBAC: Authorizing `identity:get_user(user_id=8c069df1d9354277b0629215bcb35004)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:12.336731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:12.341122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 124/242] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:12 2022] GET /identity/v3/users/8c069df1d9354277b0629215bcb35004 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:12.350431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:12.381590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279081f1-5e5f-4dc3-a98e-c32884038209 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:12.428416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:12.429477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:12.430887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:12.431364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:12.432770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:12.435339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:12.487652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 119/243] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:12 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:12.523329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54839fef-740d-49b6-b49e-06b353756f48 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:12.578030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bfb9c-4cfb-4377-a851-87ea7d7c2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:12.578687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bfb9c-4cfb-4377-a851-87ea7d7c2fdd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:12.578964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bfb9c-4cfb-4377-a851-87ea7d7c2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:12.579234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bfb9c-4cfb-4377-a851-87ea7d7c2fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:12.628896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:12.674012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bfb9c-4cfb-4377-a851-87ea7d7c2fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:12.675398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bfb9c-4cfb-4377-a851-87ea7d7c2fdd None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:12.772763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 125/244] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:12.778659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:12.795036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34a55-644e-4337-b34e-64d913f69c8f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:12.795349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34a55-644e-4337-b34e-64d913f69c8f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:12.795600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34a55-644e-4337-b34e-64d913f69c8f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:12.797242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 126/245] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:12.802009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d6054-9c2b-47b4-a3f0-712179ed52e2 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:12.802293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d6054-9c2b-47b4-a3f0-712179ed52e2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:12.802568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d6054-9c2b-47b4-a3f0-712179ed52e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:12.824462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-123d6054-9c2b-47b4-a3f0-712179ed52e2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:12.825895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-123d6054-9c2b-47b4-a3f0-712179ed52e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:12.930987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:12.940600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 127/246] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:12.943871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5ba1-054b-4cac-a7e2-cd7c1b57d081 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:12.961876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:12.964600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d6054-9c2b-47b4-a3f0-712179ed52e2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:13.000873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:13.001839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.002911 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.003359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.005980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:13.007676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:13.010386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 120/247] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:12 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:13.017014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:13.088712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d6054-9c2b-47b4-a3f0-712179ed52e2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:13.128596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:13.129269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.129549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.129814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.153234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:13.158249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:13.159083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:13.159902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:13.164883 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 128/248] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:13.172777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:13.197885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cba79-5cad-479e-b7b7-8eec44686cd1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:13.261473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:13.262430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6e7a-a412-4ae8-9823-14875793839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:13.263210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6e7a-a412-4ae8-9823-14875793839f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.263643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6e7a-a412-4ae8-9823-14875793839f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.264109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6e7a-a412-4ae8-9823-14875793839f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.264901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6e7a-a412-4ae8-9823-14875793839f None admin] RBAC: Adding query filter params (role.id=b349f604875646c88269f9a8664c03b4, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=8c069df1d9354277b0629215bcb35004) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:13.265302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6e7a-a412-4ae8-9823-14875793839f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:13.266954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6e7a-a412-4ae8-9823-14875793839f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:13.273183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 121/249] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:13 2022] GET /identity/v3/role_assignments?user.id=8c069df1d9354277b0629215bcb35004&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=b349f604875646c88269f9a8664c03b4 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:13.274359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e6d8a-d3d7-463b-a309-83b5d0acd9fa None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.274867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e6d8a-d3d7-463b-a309-83b5d0acd9fa None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.275240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e6d8a-d3d7-463b-a309-83b5d0acd9fa None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.276950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 122/250] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:13.287276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f15ab-1b25-4ad4-864a-c5121a684651 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.287740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f15ab-1b25-4ad4-864a-c5121a684651 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.288111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f15ab-1b25-4ad4-864a-c5121a684651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.319925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-bb0f15ab-1b25-4ad4-864a-c5121a684651 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:13.321162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bb0f15ab-1b25-4ad4-864a-c5121a684651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:13.355477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f2c6-af5a-46c7-8e38-8e7a29b97980 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:13.400023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:13.442793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:13.443488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.443795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.444074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.444822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:13.445116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:13.446662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:13.467554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 129/251] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:13.473496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:13.474209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 123/252] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:13.503833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f15ab-1b25-4ad4-864a-c5121a684651 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:13.669639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492413c1-f96b-4578-8478-091e1cb9dcd0 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:13.704527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:13.715882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f15ab-1b25-4ad4-864a-c5121a684651 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:13.725000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34557-8b77-4d0c-90ae-97db6bdb4c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:13.725653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34557-8b77-4d0c-90ae-97db6bdb4c21 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.725939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34557-8b77-4d0c-90ae-97db6bdb4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.726239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34557-8b77-4d0c-90ae-97db6bdb4c21 None admin] PATH_INFO: `/v3/users/8ffb605506f24717a2573780f964a465` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.728688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34557-8b77-4d0c-90ae-97db6bdb4c21 None admin] RBAC: Authorizing `identity:get_user(user_id=8ffb605506f24717a2573780f964a465)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:13.730158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34557-8b77-4d0c-90ae-97db6bdb4c21 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:13.738499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 130/253] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:13 2022] GET /identity/v3/users/8ffb605506f24717a2573780f964a465 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:13.738499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde744ee-c8df-4afd-a1c0-fc86d4e3f6d0 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.738499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde744ee-c8df-4afd-a1c0-fc86d4e3f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.738499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde744ee-c8df-4afd-a1c0-fc86d4e3f6d0 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.738499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 131/254] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:13.741113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde744ee-c8df-4afd-a1c0-fc86d4e3f6d0 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:13.768623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc6c7e-bf37-48bb-8734-8d75d1cae080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:13.769645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc6c7e-bf37-48bb-8734-8d75d1cae080 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.770199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc6c7e-bf37-48bb-8734-8d75d1cae080 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.771343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc6c7e-bf37-48bb-8734-8d75d1cae080 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.791512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc6c7e-bf37-48bb-8734-8d75d1cae080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-65cc6c7e-bf37-48bb-8734-8d75d1cae080 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:13.799236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:13.800240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:13.801029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:13.806319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 124/255] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:13.813337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655f7c7-5d17-494f-9502-1ac3c598f6f3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:13.814496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655f7c7-5d17-494f-9502-1ac3c598f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:13.815324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655f7c7-5d17-494f-9502-1ac3c598f6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:13.847790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-0655f7c7-5d17-494f-9502-1ac3c598f6f3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:13.850188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0655f7c7-5d17-494f-9502-1ac3c598f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:13.888332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:13.936568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 125/256] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:13.937260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655f7c7-5d17-494f-9502-1ac3c598f6f3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:13.970430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde744ee-c8df-4afd-a1c0-fc86d4e3f6d0 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.052329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.053238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.053669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.054114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.060344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:14.061985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:14.064024 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 132/257] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:13 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:14.065090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:14.107363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655f7c7-5d17-494f-9502-1ac3c598f6f3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.157655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.158297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.158580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.158855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.159586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:14.159919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:14.161320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:14.184372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 126/258] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:14.184968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:14.202796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:14.263987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:14.301838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432d373-123b-46dc-a66d-42a453a9ae6a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.325436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cdbd-2f3b-4d44-b158-1d0432968a07 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.361153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.361847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.362130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.362408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1/users/8ffb605506f24717a2573780f964a465/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.364935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76132606c2f4c478b357eba945315f1, user_id=8ffb605506f24717a2573780f964a465, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:14.366396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:14.386730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 127/259] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:14 2022] PUT /identity/v3/projects/d76132606c2f4c478b357eba945315f1/users/8ffb605506f24717a2573780f964a465/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:14.387681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:14.398499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.399335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.399786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.400034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.425229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:14.431942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:14.432827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:14.433621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:14.440213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 133/260] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:14.446223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:14.484605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:14.513644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523445-7068-4485-8949-d76ecc859420 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.574474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.575064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.575344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.575644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] PATH_INFO: `/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.577021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] RBAC: Authorizing `identity:get_user(user_id=7fb480cdcd4e4daebfe7c50446cd6f85)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:14.578555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:14.580686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 128/261] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:14 2022] GET /identity/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:14.586616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:14.594468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106d8c-518e-4815-81e1-d592b0814b81 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.618857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:14.642419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.643443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.643894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.644335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.645200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:14.645639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:14.647179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:14.658075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 134/262] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:14.665475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:14.767761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b56d-b2d6-40b8-916c-0936a3dd97ea None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.811844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5f823-77fd-40d4-8522-54a364fb120d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:14.828462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.829394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.829881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.830341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.868759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:14.874299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:14.875394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:14.877027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:14.878172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] PATH_INFO: `/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:14.880259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] RBAC: Authorizing `identity:get_user(user_id=7fb480cdcd4e4daebfe7c50446cd6f85)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:14.882908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:14.885491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 135/263] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:14 2022] GET /identity/v3/users/7fb480cdcd4e4daebfe7c50446cd6f85 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:14.892408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:14.947747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:14.950706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:14.977943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:15.078719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 129/264] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 06:19:15.086119 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:15.113708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26d244-b7ee-49dd-8dac-4985fc5c2f87 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:15.191642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:15.191642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.191910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.192151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.226267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:15.274508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:15.276205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:15.313388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47ad6-b70b-4d7f-99b4-4ec5d89250a2 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:15.322653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:15.377431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 136/265] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:15.377603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:15.378082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.378432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.378713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.379955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:15.381414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:15.382786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:15.386464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 130/266] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:15 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:15.392206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:15.483326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382018e-c68c-486e-b4fc-bca787ca60f3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:15.517898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d2443-c574-4dbc-b4d4-38f78c378cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:15.518555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2443-c574-4dbc-b4d4-38f78c378cf3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.518830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2443-c574-4dbc-b4d4-38f78c378cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.519104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2443-c574-4dbc-b4d4-38f78c378cf3 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.520283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d2443-c574-4dbc-b4d4-38f78c378cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:15.521740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d2443-c574-4dbc-b4d4-38f78c378cf3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:15.523570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 137/267] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:15 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:15.528809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6e4c8-bf90-487a-a2fd-1efc25ceb7e3 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.529088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6e4c8-bf90-487a-a2fd-1efc25ceb7e3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.529358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6e4c8-bf90-487a-a2fd-1efc25ceb7e3 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.530611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 138/268] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:15.530865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f88d16-884b-4bc4-8dae-34c4d3b8b46e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:15.532333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6e4c8-bf90-487a-a2fd-1efc25ceb7e3 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:15.548748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:15.560850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:15.574303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4dbe0-c3ce-44e4-8c1f-803e2d7766ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:15.575383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4dbe0-c3ce-44e4-8c1f-803e2d7766ce None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.575878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4dbe0-c3ce-44e4-8c1f-803e2d7766ce None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.576344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4dbe0-c3ce-44e4-8c1f-803e2d7766ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.577322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4dbe0-c3ce-44e4-8c1f-803e2d7766ce None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=7fb480cdcd4e4daebfe7c50446cd6f85) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:15.577845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4dbe0-c3ce-44e4-8c1f-803e2d7766ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:15.579481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4dbe0-c3ce-44e4-8c1f-803e2d7766ce None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:15.586302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 131/269] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:15 2022] GET /identity/v3/role_assignments?user.id=7fb480cdcd4e4daebfe7c50446cd6f85&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:15.587984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6e375-befe-4afa-bff6-e9a47a279c5b None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.588459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6e375-befe-4afa-bff6-e9a47a279c5b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.588940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6e375-befe-4afa-bff6-e9a47a279c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.624652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5ca6e375-befe-4afa-bff6-e9a47a279c5b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:15.626201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5ca6e375-befe-4afa-bff6-e9a47a279c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:15.642480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6e4c8-bf90-487a-a2fd-1efc25ceb7e3 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:15.716512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:15.717176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.717457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.717739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.718547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] RBAC: Adding query filter params (role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=7fb480cdcd4e4daebfe7c50446cd6f85) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:15.718859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:15.720386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:15.731850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 139/270] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:15 2022] GET /identity/v3/role_assignments?user.id=7fb480cdcd4e4daebfe7c50446cd6f85&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:15.749180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 132/271] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:15.789620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:15.905537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:15.919703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99289e6-c91b-4c68-9b76-7e5a6fce2626 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.920218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99289e6-c91b-4c68-9b76-7e5a6fce2626 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.920626 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99289e6-c91b-4c68-9b76-7e5a6fce2626 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.922467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 133/272] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:15.927649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeb41a-6ae1-46ab-81a8-ce503ba88564 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:15.927933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeb41a-6ae1-46ab-81a8-ce503ba88564 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:15.928215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeb41a-6ae1-46ab-81a8-ce503ba88564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:15.952280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78141dd1-9a4c-4fe5-a5ec-0ec7dd3d42fa None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:15.965427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-fdbeb41a-6ae1-46ab-81a8-ce503ba88564 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:15.966645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-fdbeb41a-6ae1-46ab-81a8-ce503ba88564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:16.001430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26b384-82e9-4dee-9f4f-7ce8fc3bfdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.002121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b384-82e9-4dee-9f4f-7ce8fc3bfdb5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.002363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b384-82e9-4dee-9f4f-7ce8fc3bfdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.002639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b384-82e9-4dee-9f4f-7ce8fc3bfdb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.013422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26b384-82e9-4dee-9f4f-7ce8fc3bfdb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-5f26b384-82e9-4dee-9f4f-7ce8fc3bfdb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:16.018837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:16.019969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:16.020984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:16.027797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 140/273] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:16.033096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64790d9b-7c62-448b-a54c-be082d7a4870 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.033391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64790d9b-7c62-448b-a54c-be082d7a4870 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.033640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64790d9b-7c62-448b-a54c-be082d7a4870 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.035701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 141/274] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:16.037008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64790d9b-7c62-448b-a54c-be082d7a4870 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.067726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 134/275] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:16.068643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a309bf-07fa-43e2-ba02-0efa78b4f1ff None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.069116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a309bf-07fa-43e2-ba02-0efa78b4f1ff None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.069406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a309bf-07fa-43e2-ba02-0efa78b4f1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.092066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-81a309bf-07fa-43e2-ba02-0efa78b4f1ff None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:16.093286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-81a309bf-07fa-43e2-ba02-0efa78b4f1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:16.145924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:16.158474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64790d9b-7c62-448b-a54c-be082d7a4870 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.175188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 135/276] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:16.176647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a309bf-07fa-43e2-ba02-0efa78b4f1ff None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.202488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.203128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.203438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.204260 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.204983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:16.205292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:16.206681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:16.212073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:16.216650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 142/277] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:16.217706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.287608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a309bf-07fa-43e2-ba02-0efa78b4f1ff None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.320082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d352fc-b29c-407c-89cb-fdeaf4cea238 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.322693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.323347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.323655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.323935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.325074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:16.326515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:16.328163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 136/278] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:16.328952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.362796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.363453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.363774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.364057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.374592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:16.379649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:16.380563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:16.381427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 143/279] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:16.382088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.383321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:16.446260 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:16.448410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6df2b-d516-42c4-a157-4655c12a2bc1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.484394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.485052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.485335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.485664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] PATH_INFO: `/v3/users/32852b5bf90948d4b2c2b877e0361e34` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.491783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d61d8-6e82-4778-bcd2-5759096449e9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.499723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=32852b5bf90948d4b2c2b877e0361e34)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:16.501221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:16.503085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 137/280] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/users/32852b5bf90948d4b2c2b877e0361e34 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:16.503680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.531040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.531341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.531637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.531915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.532582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:16.534026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:16.556715 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 144/281] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:16 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:16.568042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.652015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b064e5-1f9d-4aea-a89d-a9e7be062ef9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.654629 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:16.673360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6da5b8-4a3c-46e2-9dc8-9540a00197a2 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.691982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:16.704043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.705864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.706338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.707137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.708572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:16.709500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:16.712156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:16.716485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.717237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.717581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.717962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.718820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, user.id=32852b5bf90948d4b2c2b877e0361e34, scope.system=all) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:16.719188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:16.720880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:16.724447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 138/282] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:16.730677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 145/283] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/role_assignments?user.id=32852b5bf90948d4b2c2b877e0361e34&scope.system=all&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:16.732039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:16.856461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb74e3-8089-4386-8634-32a48b948e17 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:16.903814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:16.904482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:16.904763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:16.905033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] PATH_INFO: `/v3/users/8c069df1d9354277b0629215bcb35004` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:16.906213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] RBAC: Authorizing `identity:get_user(user_id=8c069df1d9354277b0629215bcb35004)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:16.907822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:16.909758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 139/284] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/users/8c069df1d9354277b0629215bcb35004 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:16.915587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:17.030027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ac9a2-ecaf-4fa0-a8f5-968db1054fc2 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:17.065929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fa29-7f1c-4e5e-91c6-34496e197f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:17.066974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fa29-7f1c-4e5e-91c6-34496e197f66 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:17.067460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fa29-7f1c-4e5e-91c6-34496e197f66 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:17.068011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fa29-7f1c-4e5e-91c6-34496e197f66 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:17.069482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03fa29-7f1c-4e5e-91c6-34496e197f66 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:17.071194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03fa29-7f1c-4e5e-91c6-34496e197f66 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:17.073881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 146/285] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:16 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:17.079714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:17.116740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:17.186832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d30f0-30e4-48e8-b435-470b6946e565 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:17.221593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b805f-fa16-460c-b455-bbbdc53fedde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:17.222283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b805f-fa16-460c-b455-bbbdc53fedde None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:17.222566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b805f-fa16-460c-b455-bbbdc53fedde None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:17.222837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b805f-fa16-460c-b455-bbbdc53fedde None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1/users/8c069df1d9354277b0629215bcb35004/roles/b349f604875646c88269f9a8664c03b4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:17.224957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b805f-fa16-460c-b455-bbbdc53fedde None admin] RBAC: Authorizing `identity:create_grant(project_id=d76132606c2f4c478b357eba945315f1, user_id=8c069df1d9354277b0629215bcb35004, role_id=b349f604875646c88269f9a8664c03b4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:17.226419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b805f-fa16-460c-b455-bbbdc53fedde None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:17.242985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 140/286] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:17 2022] PUT /identity/v3/projects/d76132606c2f4c478b357eba945315f1/users/8c069df1d9354277b0629215bcb35004/roles/b349f604875646c88269f9a8664c03b4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:17.250702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62384d-0907-41de-93e3-f080926a91cb None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:17.250995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62384d-0907-41de-93e3-f080926a91cb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:17.251293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62384d-0907-41de-93e3-f080926a91cb None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:17.252718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 147/287] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:17.258607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d10e6-f4c9-420a-8f80-206083611d65 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:17.258934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d10e6-f4c9-420a-8f80-206083611d65 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:17.259240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d10e6-f4c9-420a-8f80-206083611d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:17.280874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-701d10e6-f4c9-420a-8f80-206083611d65 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:17.282071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-701d10e6-f4c9-420a-8f80-206083611d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:17.359534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 141/288] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:17.390473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62384d-0907-41de-93e3-f080926a91cb None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:17.459282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:17.516679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62384d-0907-41de-93e3-f080926a91cb None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:17.567943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:17.568989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:17.569458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:17.569973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:17.586805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:17.592756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:17.593636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:17.594437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:17.596735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 148/289] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:17.602690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d10e6-f4c9-420a-8f80-206083611d65 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:17.654518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:17.776448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d10e6-f4c9-420a-8f80-206083611d65 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:17.821358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:17.821923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:17.822567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:17.822850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:17.823578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:17.823904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:17.825299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:17.834117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 142/290] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:17.839840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:17.989517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6c948-13b0-425b-9196-3b964ff7ccd6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:18.001463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:18.033319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:18.034387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:18.034387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:18.034516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] PATH_INFO: `/v3/users/8ffb605506f24717a2573780f964a465` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:18.040373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] RBAC: Authorizing `identity:get_user(user_id=8ffb605506f24717a2573780f964a465)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:18.041844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:18.043687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 149/291] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:17 2022] GET /identity/v3/users/8ffb605506f24717a2573780f964a465 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:18.049104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:18.174034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:18.198643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0401-c756-46f5-a554-0aa385f5697e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:18.249489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:18.250121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:18.250404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:18.250679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:18.347105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:18.348611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:18.464777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:18.486271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 143/292] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:18.491885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:18.611554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2b38-a285-46c6-9063-eebedd97af65 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:18.651152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6709220-bb5e-450a-a28a-775076f5cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:18.651844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709220-bb5e-450a-a28a-775076f5cf28 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:18.652131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709220-bb5e-450a-a28a-775076f5cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:18.652407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709220-bb5e-450a-a28a-775076f5cf28 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:18.653594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6709220-bb5e-450a-a28a-775076f5cf28 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:18.655054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6709220-bb5e-450a-a28a-775076f5cf28 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:18.656938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 150/293] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:18 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:18.662732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:18.770340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773374e3-f7cc-4ac1-8320-92bc74d39838 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:18.804646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a151-a8fb-40f0-9c8f-f102699a5db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:18.805277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a151-a8fb-40f0-9c8f-f102699a5db1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:18.805556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a151-a8fb-40f0-9c8f-f102699a5db1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:18.805888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a151-a8fb-40f0-9c8f-f102699a5db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:18.806678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206a151-a8fb-40f0-9c8f-f102699a5db1 None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=8ffb605506f24717a2573780f964a465) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:18.806986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206a151-a8fb-40f0-9c8f-f102699a5db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:18.808458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206a151-a8fb-40f0-9c8f-f102699a5db1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:18.814632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 144/294] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:18 2022] GET /identity/v3/role_assignments?user.id=8ffb605506f24717a2573780f964a465&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:19.180045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5ca0-5310-405b-b7d7-34f7d7cddc39 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.181097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5ca0-5310-405b-b7d7-34f7d7cddc39 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.181576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5ca0-5310-405b-b7d7-34f7d7cddc39 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.183155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 151/295] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:19.188753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3b1d-dc36-4c44-b450-a624b483523b None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.189265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3b1d-dc36-4c44-b450-a624b483523b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.189734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3b1d-dc36-4c44-b450-a624b483523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.210533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-917c3b1d-dc36-4c44-b450-a624b483523b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:19.211875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-917c3b1d-dc36-4c44-b450-a624b483523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:19.264903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:19.297083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 145/296] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:19.307264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51dc19-13f1-408d-b57b-8ac21aacdbf6 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.307845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51dc19-13f1-408d-b57b-8ac21aacdbf6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.308314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51dc19-13f1-408d-b57b-8ac21aacdbf6 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.310120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 152/297] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:19.315024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f11cde-973b-49c2-8925-2d4f8e30cb5a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.315319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f11cde-973b-49c2-8925-2d4f8e30cb5a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.315727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f11cde-973b-49c2-8925-2d4f8e30cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.317205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056def-5df3-4fac-b0e4-da9049fbe038 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.317886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056def-5df3-4fac-b0e4-da9049fbe038 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.318398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056def-5df3-4fac-b0e4-da9049fbe038 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.320202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 153/298] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:19.321387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056def-5df3-4fac-b0e4-da9049fbe038 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:19.335017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-44f11cde-973b-49c2-8925-2d4f8e30cb5a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:19.336258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-44f11cde-973b-49c2-8925-2d4f8e30cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:19.376412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:19.408856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 146/299] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:19.410581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f834ea-7b2a-4b6c-8357-be225faa940c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.410997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f834ea-7b2a-4b6c-8357-be225faa940c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.411409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f834ea-7b2a-4b6c-8357-be225faa940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.437407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-26f834ea-7b2a-4b6c-8357-be225faa940c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:19.437903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056def-5df3-4fac-b0e4-da9049fbe038 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:19.438593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-26f834ea-7b2a-4b6c-8357-be225faa940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:19.473356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:19.474241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.474832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.476146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.488748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:19.495728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:19.496867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:19.497872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:19.500875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 154/300] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:19.501357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:19.513029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 147/301] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:19.514625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f834ea-7b2a-4b6c-8357-be225faa940c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:19.566301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:19.618402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2772659-557d-4195-82e2-326a56116d07 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:19.621615 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:19.628124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f834ea-7b2a-4b6c-8357-be225faa940c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:19.656471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:19.657128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.657406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.657683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.662728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:19.663354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.663645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.663925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.664640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:19.664983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:19.666332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:19.669706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:19.674588 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 148/302] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:19.675344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:19.676231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:19.677032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 155/303] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:19.680135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:19.680246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:19.788399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:19.791426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cda72-6ccd-4008-a447-d9ef9e287e19 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:19.791907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480add0e-8c96-4387-8a9c-3da51bf1d788 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:19.826771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:19.826990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:19.827341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.827643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.827836 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.827933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.828119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.828450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] PATH_INFO: `/v3/users/32852b5bf90948d4b2c2b877e0361e34` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.829057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:19.829536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] RBAC: Authorizing `identity:get_user(user_id=32852b5bf90948d4b2c2b877e0361e34)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:19.830503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:19.830961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:19.832351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 149/304] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:19.837004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 156/305] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:19 2022] GET /identity/v3/users/32852b5bf90948d4b2c2b877e0361e34 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:19.837578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:19.838132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:19.871308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:19.936682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcaeeb-984d-4a31-9e1d-1783546b7721 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:19.946391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3cd9e-9d42-4cdf-ba10-4bf60fbae762 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:19.973568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:19.974197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.974479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.974748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.975504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:19.975824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:19.977220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:19.979964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f9f4b-9e23-426b-b111-713a728e391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:19.980590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9f4b-9e23-426b-b111-713a728e391a None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:19.980871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9f4b-9e23-426b-b111-713a728e391a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:19.981143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9f4b-9e23-426b-b111-713a728e391a None admin] PATH_INFO: `/v3/groups` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:19.981793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f9f4b-9e23-426b-b111-713a728e391a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:19.983191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f9f4b-9e23-426b-b111-713a728e391a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:19.985368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 150/306] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:19.990524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:20.011652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 157/307] 10.222.0.58 () {60 vars in 1134 bytes} [Thu Jul 28 06:19:19 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:20.011652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580b2a-f4a7-4a0a-8b33-b242926be1cb None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.011652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580b2a-f4a7-4a0a-8b33-b242926be1cb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.011652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580b2a-f4a7-4a0a-8b33-b242926be1cb None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.011652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 158/308] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:20.011652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0580b2a-f4a7-4a0a-8b33-b242926be1cb None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:20.043553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:20.119454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:20.128121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9dfa4-b7ec-4af5-9cde-85c83c5399ab None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:20.133513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0580b2a-f4a7-4a0a-8b33-b242926be1cb None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:20.166492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df005-43c2-458a-9f8f-5924260c6d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:20.167157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df005-43c2-458a-9f8f-5924260c6d4a None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.167435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df005-43c2-458a-9f8f-5924260c6d4a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.167733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df005-43c2-458a-9f8f-5924260c6d4a None admin] PATH_INFO: `/v3/system/users/32852b5bf90948d4b2c2b877e0361e34/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.169388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df005-43c2-458a-9f8f-5924260c6d4a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=32852b5bf90948d4b2c2b877e0361e34, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:20.170942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df005-43c2-458a-9f8f-5924260c6d4a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:20.174489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:20.175844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.176157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.176518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] PATH_INFO: `/v3/users/3a2cdcb4d9ed4df38008f65cfceaa883` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.181685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 151/309] 10.222.0.58 () {58 vars in 1334 bytes} [Thu Jul 28 06:19:19 2022] PUT /identity/v3/system/users/32852b5bf90948d4b2c2b877e0361e34/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:20.182134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c1d79-928c-4600-b442-795c32b897f0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.182421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c1d79-928c-4600-b442-795c32b897f0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.182692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c1d79-928c-4600-b442-795c32b897f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.197630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2cdcb4d9ed4df38008f65cfceaa883)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:20.199162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:20.200987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 159/310] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:20 2022] GET /identity/v3/users/3a2cdcb4d9ed4df38008f65cfceaa883 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:20.205577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b83c1d79-928c-4600-b442-795c32b897f0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:20.205913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b83c1d79-928c-4600-b442-795c32b897f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:20.207953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:20.310893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 152/311] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:20.333253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c1d79-928c-4600-b442-795c32b897f0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:20.349278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9c538-29f1-4a9e-a4be-42821a0886a6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:20.363501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:20.394547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:20.395791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.396384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.396994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.398349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] RBAC: Adding query filter params (role.id=b349f604875646c88269f9a8664c03b4, user.id=3a2cdcb4d9ed4df38008f65cfceaa883, scope.system=all) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:20.398852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:20.400976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:20.408147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 160/312] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Jul 28 06:19:20 2022] GET /identity/v3/role_assignments?user.id=3a2cdcb4d9ed4df38008f65cfceaa883&scope.system=all&role.id=b349f604875646c88269f9a8664c03b4 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:20.462937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c1d79-928c-4600-b442-795c32b897f0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:20.502296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:20.503338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.503822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.504270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.517026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:20.523094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:20.524064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:20.524931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:20.531658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 153/313] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:20.534074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:20.552001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:20.646502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31bfa2-7a0b-43fe-b677-d035ddeb2c63 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:20.681998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:20.683016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.683508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.684040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.684991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:20.685486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:20.687095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:20.696893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 161/314] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:20.703045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:20.796092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:20.808403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6861b27-0b87-464e-8067-d37a78de06c6 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:20.844021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:20.844679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:20.844959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:20.845232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] PATH_INFO: `/v3/users/8c069df1d9354277b0629215bcb35004` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:20.846423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] RBAC: Authorizing `identity:get_user(user_id=8c069df1d9354277b0629215bcb35004)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:20.847907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:20.850050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 154/315] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:20 2022] GET /identity/v3/users/8c069df1d9354277b0629215bcb35004 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:20.855780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:20.948234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:20.971028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199e74b-5a03-4183-9d8f-0edd785f4de5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:21.004467 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:21.005095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:21.005375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:21.005652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:21.077817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:21.079652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:21.158690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:21.186979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 162/316] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:21.193448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:21.299908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c33a8a-4c09-450a-a6d6-1d5ce18c20d5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:21.334681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efcdda-dd42-4d97-a578-699e899c8887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:21.335337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcdda-dd42-4d97-a578-699e899c8887 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:21.335634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcdda-dd42-4d97-a578-699e899c8887 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:21.335919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcdda-dd42-4d97-a578-699e899c8887 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:21.337229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efcdda-dd42-4d97-a578-699e899c8887 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:21.338774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efcdda-dd42-4d97-a578-699e899c8887 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:21.340877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 155/317] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:21 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:21.346983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:21.452469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cbb8d-73a4-4042-9222-eb8cf2efb86e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:21.485857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152362a2-599a-4a9c-9b66-4febd949a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:21.486481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152362a2-599a-4a9c-9b66-4febd949a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:21.486754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152362a2-599a-4a9c-9b66-4febd949a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:21.487023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152362a2-599a-4a9c-9b66-4febd949a0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:21.487829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152362a2-599a-4a9c-9b66-4febd949a0e5 None admin] RBAC: Adding query filter params (role.id=b349f604875646c88269f9a8664c03b4, scope.project.id=d76132606c2f4c478b357eba945315f1, user.id=8c069df1d9354277b0629215bcb35004) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:21.488136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152362a2-599a-4a9c-9b66-4febd949a0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:21.489592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152362a2-599a-4a9c-9b66-4febd949a0e5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:21.495816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 163/318] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:21 2022] GET /identity/v3/role_assignments?user.id=8c069df1d9354277b0629215bcb35004&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=b349f604875646c88269f9a8664c03b4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:22.095974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cef87-7770-4bd7-a179-b0a5105d421a None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.096507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cef87-7770-4bd7-a179-b0a5105d421a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.096507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cef87-7770-4bd7-a179-b0a5105d421a None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.097827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 156/319] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:22.103234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095be5-2963-4b62-ad00-f58082eafbf4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.103492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095be5-2963-4b62-ad00-f58082eafbf4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.103830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095be5-2963-4b62-ad00-f58082eafbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.122967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7b095be5-2963-4b62-ad00-f58082eafbf4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:22.124186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7b095be5-2963-4b62-ad00-f58082eafbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:22.159693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:22.194101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 164/320] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:22.216409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cef87-7770-4bd7-a179-b0a5105d421a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.239124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:22.253859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5e50-694a-4f98-b9b5-12c7e8e8a500 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.254363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5e50-694a-4f98-b9b5-12c7e8e8a500 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.254643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5e50-694a-4f98-b9b5-12c7e8e8a500 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.256053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 165/321] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:22.261077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33df39e-bcee-48a4-bcaa-4818b201a363 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.261359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33df39e-bcee-48a4-bcaa-4818b201a363 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.261636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33df39e-bcee-48a4-bcaa-4818b201a363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.280001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d33df39e-bcee-48a4-bcaa-4818b201a363 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:22.281091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d33df39e-bcee-48a4-bcaa-4818b201a363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:22.327878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cef87-7770-4bd7-a179-b0a5105d421a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:22.350044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 166/322] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:22.368775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:22.369427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.369699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.369971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.371136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:22.372699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:22.373078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33df39e-bcee-48a4-bcaa-4818b201a363 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.374436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 157/323] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:22.379637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.465496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:22.473184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:22.476264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33df39e-bcee-48a4-bcaa-4818b201a363 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:22.478318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e37cfb-95fb-4e45-a308-bed6dcc8a289 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:22.511776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a61983-89d5-4125-89ed-be100ebdcb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:22.512397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61983-89d5-4125-89ed-be100ebdcb77 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.512674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61983-89d5-4125-89ed-be100ebdcb77 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.512997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61983-89d5-4125-89ed-be100ebdcb77 None admin] PATH_INFO: `/v3/groups` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.513656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a61983-89d5-4125-89ed-be100ebdcb77 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:22.515129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a61983-89d5-4125-89ed-be100ebdcb77 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:22.515391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cc7f8-4a36-448a-b5a2-447ebf2a6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:22.516079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cc7f8-4a36-448a-b5a2-447ebf2a6938 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.516363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cc7f8-4a36-448a-b5a2-447ebf2a6938 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.516640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cc7f8-4a36-448a-b5a2-447ebf2a6938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.527870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cc7f8-4a36-448a-b5a2-447ebf2a6938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:22.533094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 158/324] 10.222.0.58 () {60 vars in 1134 bytes} [Thu Jul 28 06:19:22 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-8f5cc7f8-4a36-448a-b5a2-447ebf2a6938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:22.533297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:22.534141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:22.534998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:22.535600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cae50-4562-4dda-9cb4-cf0c295446cc None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.535600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cae50-4562-4dda-9cb4-cf0c295446cc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.535600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cae50-4562-4dda-9cb4-cf0c295446cc None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.536355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 159/325] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:22.539673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 167/326] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:22.540775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cae50-4562-4dda-9cb4-cf0c295446cc None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.544939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f18799-3892-4f11-b161-e7e4ff9404e5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.545231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f18799-3892-4f11-b161-e7e4ff9404e5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.545509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f18799-3892-4f11-b161-e7e4ff9404e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.573344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a9f18799-3892-4f11-b161-e7e4ff9404e5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:22.575187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a9f18799-3892-4f11-b161-e7e4ff9404e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:22.650661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 168/327] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:22.662855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cae50-4562-4dda-9cb4-cf0c295446cc None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:22.673342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f18799-3892-4f11-b161-e7e4ff9404e5 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.702316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:22.702951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.703235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.703509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.704276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:22.704586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:22.706016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:22.721259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 160/328] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:22.722591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.735580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:22.786197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:22.797967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f18799-3892-4f11-b161-e7e4ff9404e5 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:22.843152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:22.843905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.844193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.844469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.847965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3edc7-f5bf-4a9d-a8d3-d9618b3d115e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:22.859206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:22.866332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:22.867243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:22.868271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 169/329] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:22.874158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.893785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:22.893785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:22.893785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:22.893785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] PATH_INFO: `/v3/users/32852b5bf90948d4b2c2b877e0361e34` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:22.894185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] RBAC: Authorizing `identity:get_user(user_id=32852b5bf90948d4b2c2b877e0361e34)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:22.895575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:22.897449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 161/330] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:22 2022] GET /identity/v3/users/32852b5bf90948d4b2c2b877e0361e34 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:22.902986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:22.994262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:23.008764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b78d9-2838-43e9-b5f1-5e7600c10b91 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:23.035098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68d49-1024-4e35-bcb8-40a2d9b08e1f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:23.052037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:23.053229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:23.054135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:23.054856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:23.055843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:23.056605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:23.058572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:23.071838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 170/331] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:23.077440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:23.078055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:23.078160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:23.078349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:23.078624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:23.079421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] RBAC: Adding query filter params (role.id=d02524abaa4649c8bd246eac91a4f773, user.id=32852b5bf90948d4b2c2b877e0361e34, scope.system=all) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:23.079790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:23.081273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:23.095947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 162/332] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Jul 28 06:19:22 2022] GET /identity/v3/role_assignments?user.id=32852b5bf90948d4b2c2b877e0361e34&scope.system=all&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:23.098210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:23.203495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba04241-1bbd-404d-bd50-d68f015a4251 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:23.246796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2bc8b-c91c-44d9-b76b-e40f1c21f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:23.247936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bc8b-c91c-44d9-b76b-e40f1c21f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:23.248435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bc8b-c91c-44d9-b76b-e40f1c21f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:23.248929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bc8b-c91c-44d9-b76b-e40f1c21f6c3 None admin] PATH_INFO: `/v3/users/3a2cdcb4d9ed4df38008f65cfceaa883` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:23.250658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2bc8b-c91c-44d9-b76b-e40f1c21f6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2cdcb4d9ed4df38008f65cfceaa883)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:23.252363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2bc8b-c91c-44d9-b76b-e40f1c21f6c3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:23.254613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 171/333] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:23 2022] GET /identity/v3/users/3a2cdcb4d9ed4df38008f65cfceaa883 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:23.260340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:23.378908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a966-52ed-4275-b57a-77e7e1fddf6a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:23.417061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d3c49-8f9f-4f61-be47-5b17ccdb0a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:23.417736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3c49-8f9f-4f61-be47-5b17ccdb0a34 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:23.418074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3c49-8f9f-4f61-be47-5b17ccdb0a34 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:23.418282 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3c49-8f9f-4f61-be47-5b17ccdb0a34 None admin] PATH_INFO: `/v3/system/users/3a2cdcb4d9ed4df38008f65cfceaa883/roles/b349f604875646c88269f9a8664c03b4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:23.419830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d3c49-8f9f-4f61-be47-5b17ccdb0a34 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3a2cdcb4d9ed4df38008f65cfceaa883, role_id=b349f604875646c88269f9a8664c03b4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:23.421234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d3c49-8f9f-4f61-be47-5b17ccdb0a34 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:23.424294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:23.432117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 163/334] 10.222.0.58 () {58 vars in 1334 bytes} [Thu Jul 28 06:19:23 2022] PUT /identity/v3/system/users/3a2cdcb4d9ed4df38008f65cfceaa883/roles/b349f604875646c88269f9a8664c03b4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:24.968743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3770-3b78-41a5-ab77-d0ba4b092e45 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:24.969300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3770-3b78-41a5-ab77-d0ba4b092e45 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:24.969300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3770-3b78-41a5-ab77-d0ba4b092e45 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:24.970917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 172/335] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:24.975943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931806e-8a0f-4c60-838d-07b160f99732 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:24.976791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931806e-8a0f-4c60-838d-07b160f99732 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:24.977280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931806e-8a0f-4c60-838d-07b160f99732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:24.985956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa9dd-7d2e-4a51-a085-d4f075e4f15a None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:24.986524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa9dd-7d2e-4a51-a085-d4f075e4f15a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:24.986997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa9dd-7d2e-4a51-a085-d4f075e4f15a None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:24.988586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 173/336] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:24.993972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2d033-abd4-44e6-b70c-db24ff1ba5a9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:24.994551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2d033-abd4-44e6-b70c-db24ff1ba5a9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:24.995029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2d033-abd4-44e6-b70c-db24ff1ba5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:25.005266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a931806e-8a0f-4c60-838d-07b160f99732 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:25.007577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a931806e-8a0f-4c60-838d-07b160f99732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:25.020758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5db2d033-abd4-44e6-b70c-db24ff1ba5a9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:25.022619 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5db2d033-abd4-44e6-b70c-db24ff1ba5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:25.122062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 164/337] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:25.150275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 174/338] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:25.162864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931806e-8a0f-4c60-838d-07b160f99732 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:25.215758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2d033-abd4-44e6-b70c-db24ff1ba5a9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:25.231227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:25.332308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931806e-8a0f-4c60-838d-07b160f99732 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:25.386339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:25.395281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:25.396125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:25.396419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:25.396706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:25.413847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:25.417757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2d033-abd4-44e6-b70c-db24ff1ba5a9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:25.419089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:25.420042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:25.420821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:25.421406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 165/339] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:25.427637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:25.520518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:25.521207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:25.521714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:25.522173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:25.552754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:25.558170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:25.559067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:25.559874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:25.565548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 175/340] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:25.570907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:25.585181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5cfd-000d-409c-b89e-2e78944b5722 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:25.629603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:25.630257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:25.630543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:25.630827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:25.632122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:25.632488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:25.633966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:25.648597 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 166/341] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:25.655250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:25.714119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:25.746837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:25.774420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dfd09-7820-412e-84d7-c620fc1a4f56 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:25.810542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3e46-21ec-4674-b2e3-1c5fcf5ec7a8 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:25.843877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:25.844669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:25.844955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:25.845236 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:25.846007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:25.846477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:25.848246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:25.857218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:25.857992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:25.858368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:25.858736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:25.868339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 176/342] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:25.874277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:25.956190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:25.957847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:25.995429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5546ed-ea07-4820-b6c6-7c33864bdfb7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.030441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.039742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.052349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ee02f-2307-4a04-9054-63017e0423b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:26.053256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ee02f-2307-4a04-9054-63017e0423b2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.053681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ee02f-2307-4a04-9054-63017e0423b2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.054110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ee02f-2307-4a04-9054-63017e0423b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.127066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 167/343] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:26.146211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:26.164466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ee02f-2307-4a04-9054-63017e0423b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:26.167832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ee02f-2307-4a04-9054-63017e0423b2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:26.273604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 177/344] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 06:19:26.274994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe394-a5c4-4e20-81ed-eccc207354a2 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.275282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe394-a5c4-4e20-81ed-eccc207354a2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.275934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe394-a5c4-4e20-81ed-eccc207354a2 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.277630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 178/345] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:26.279975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabe394-a5c4-4e20-81ed-eccc207354a2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:26.300822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f5dd0-380d-440b-8c26-872a3afd7040 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.337456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ead39-7527-49e8-8018-45aa0cad5b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:26.338123 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ead39-7527-49e8-8018-45aa0cad5b6a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.338259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.338401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ead39-7527-49e8-8018-45aa0cad5b6a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.338673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ead39-7527-49e8-8018-45aa0cad5b6a None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.340039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ead39-7527-49e8-8018-45aa0cad5b6a None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:26.341575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ead39-7527-49e8-8018-45aa0cad5b6a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:26.343939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 168/346] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:26 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:26.345280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaec1-cbfc-454b-afd7-84ec2ca2db93 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.346012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaec1-cbfc-454b-afd7-84ec2ca2db93 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.346012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaec1-cbfc-454b-afd7-84ec2ca2db93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.364638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d0efaec1-cbfc-454b-afd7-84ec2ca2db93 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:26.365841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d0efaec1-cbfc-454b-afd7-84ec2ca2db93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:26.381669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.409068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabe394-a5c4-4e20-81ed-eccc207354a2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.471043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 169/347] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:26.471412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaec1-cbfc-454b-afd7-84ec2ca2db93 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:26.491458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6da93-1669-45dd-b2ae-169021f5cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:26.492180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6da93-1669-45dd-b2ae-169021f5cd1a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.492458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6da93-1669-45dd-b2ae-169021f5cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.492733 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6da93-1669-45dd-b2ae-169021f5cd1a None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.496415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6da93-1669-45dd-b2ae-169021f5cd1a None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:26.497875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6da93-1669-45dd-b2ae-169021f5cd1a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:26.499887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 179/348] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:26 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:26.501055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004547e-753b-4f5c-b4a7-bab8800e3170 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.501331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004547e-753b-4f5c-b4a7-bab8800e3170 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.501602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004547e-753b-4f5c-b4a7-bab8800e3170 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.507911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 180/349] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:26.509316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34eec-3d0e-4951-a33f-ae99c0a57653 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.509606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34eec-3d0e-4951-a33f-ae99c0a57653 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.509879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34eec-3d0e-4951-a33f-ae99c0a57653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.535230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-42f34eec-3d0e-4951-a33f-ae99c0a57653 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:26.536355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-42f34eec-3d0e-4951-a33f-ae99c0a57653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:26.600907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaec1-cbfc-454b-afd7-84ec2ca2db93 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.612743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 181/350] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:26.613600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f34eec-3d0e-4951-a33f-ae99c0a57653 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:26.647394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:26.649106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.649428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.649704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.652754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.659091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:26.661425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:26.663438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 170/351] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:26 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:26.664518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:26.683166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.746611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f34eec-3d0e-4951-a33f-ae99c0a57653 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.795979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a9fa0-412c-479d-9f13-574b0b3e5ea3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.800448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:26.801390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.801671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.801941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.804201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:26.806088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:26.808632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 182/352] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:26 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:26.809487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:26.844925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:26.845581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:26.845837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:26.846088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:26.859246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:26.864680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:26.865791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 06:19:26.866599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:26.868355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 171/353] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:26.869179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:26.944854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.952732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3014055-d699-4ee0-a90c-245468eb5724 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.967565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:26.996976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71819de-405f-4246-b4bd-2e33f1a766ea None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:26.999969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0f240-ba3a-43ca-b232-e5bd44c11e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.001206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f240-ba3a-43ca-b232-e5bd44c11e15 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.001687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f240-ba3a-43ca-b232-e5bd44c11e15 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.002191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f240-ba3a-43ca-b232-e5bd44c11e15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.016069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0f240-ba3a-43ca-b232-e5bd44c11e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-aac0f240-ba3a-43ca-b232-e5bd44c11e15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:27.021266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:27.022147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:27.022915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:27.026947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 183/354] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:27.028745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a75b4-1529-4768-a876-b52eb6c23bc7 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.028745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a75b4-1529-4768-a876-b52eb6c23bc7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.028993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a75b4-1529-4768-a876-b52eb6c23bc7 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.034386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 184/355] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:27.035173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a75b4-1529-4768-a876-b52eb6c23bc7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.042057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.042690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.042967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.043236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.046913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:27.046913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.046913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:27.056210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 172/356] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:26 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:27.056741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.171297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a75b4-1529-4768-a876-b52eb6c23bc7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.206561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aef54-f663-4d87-950e-83c920d68e31 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.231596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfac85d-531b-4650-af2a-1dcff977e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.232953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac85d-531b-4650-af2a-1dcff977e692 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.233455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac85d-531b-4650-af2a-1dcff977e692 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.234347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac85d-531b-4650-af2a-1dcff977e692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.235394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfac85d-531b-4650-af2a-1dcff977e692 None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:27.235954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfac85d-531b-4650-af2a-1dcff977e692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.238409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfac85d-531b-4650-af2a-1dcff977e692 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:27.248567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 185/357] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:27.250964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eea87-787d-4ee6-9b1a-3b99f1e6bf06 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.251502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eea87-787d-4ee6-9b1a-3b99f1e6bf06 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.252470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eea87-787d-4ee6-9b1a-3b99f1e6bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.257884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.258558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.258845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.259214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.260066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] RBAC: Adding query filter params (name=reader) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:27.260381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.262237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:27.272409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:27.276564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 173/358] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:27.277452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.280238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d43eea87-787d-4ee6-9b1a-3b99f1e6bf06 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:27.281793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d43eea87-787d-4ee6-9b1a-3b99f1e6bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:27.320806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:27.375967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 186/359] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:27.377313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eea87-787d-4ee6-9b1a-3b99f1e6bf06 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.480475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cd615-6e88-473e-b4a2-e289e0bc234f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.517571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eea87-787d-4ee6-9b1a-3b99f1e6bf06 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.525307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.525951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.526230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.526985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.527757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:27.528063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.529846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:27.541956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 174/360] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:27.543165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.558563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b31fe-e484-41f6-8151-dbb4c51da771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.559308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b31fe-e484-41f6-8151-dbb4c51da771 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.559684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b31fe-e484-41f6-8151-dbb4c51da771 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.560031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b31fe-e484-41f6-8151-dbb4c51da771 None admin] PATH_INFO: `/v3/users/3a2cdcb4d9ed4df38008f65cfceaa883` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.561334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b31fe-e484-41f6-8151-dbb4c51da771 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2cdcb4d9ed4df38008f65cfceaa883)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.562920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b31fe-e484-41f6-8151-dbb4c51da771 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:27.564578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 187/361] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/users/3a2cdcb4d9ed4df38008f65cfceaa883 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:27.565794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f411dc-d06e-409d-9122-aa65e3b4e6b1 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.566102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f411dc-d06e-409d-9122-aa65e3b4e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.566342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f411dc-d06e-409d-9122-aa65e3b4e6b1 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.567720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 188/362] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:27.568377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f411dc-d06e-409d-9122-aa65e3b4e6b1 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.600093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:27.636253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:27.682398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501e13-5de3-40cd-b36b-9c11ef628d36 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.703956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f411dc-d06e-409d-9122-aa65e3b4e6b1 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.719887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ea0b6-0a89-4e4c-b509-e4fb31c724d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.720549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ea0b6-0a89-4e4c-b509-e4fb31c724d3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.720832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ea0b6-0a89-4e4c-b509-e4fb31c724d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.721106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ea0b6-0a89-4e4c-b509-e4fb31c724d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.732091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ea0b6-0a89-4e4c-b509-e4fb31c724d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-184ea0b6-0a89-4e4c-b509-e4fb31c724d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:27.738349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:27.739279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:27.740121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 175/363] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:27.741180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c07-1fb8-4ca4-843a-4890d4564ac3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.741437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c07-1fb8-4ca4-843a-4890d4564ac3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.741693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c07-1fb8-4ca4-843a-4890d4564ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.750516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.751163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.751442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.751749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.760227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ddbe7c07-1fb8-4ca4-843a-4890d4564ac3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:27.761427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ddbe7c07-1fb8-4ca4-843a-4890d4564ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:27.830842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 176/364] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:27.831736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7c07-1fb8-4ca4-843a-4890d4564ac3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.833967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.836774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:27.860025 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:27.885873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:27.939641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7c07-1fb8-4ca4-843a-4890d4564ac3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.959392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 189/365] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:27.960481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.983839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.984868 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.985147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.985421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.986221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] RBAC: Adding query filter params (role.id=b349f604875646c88269f9a8664c03b4, user.id=3a2cdcb4d9ed4df38008f65cfceaa883, scope.system=all) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:27.986530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.988829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:28.006877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 177/366] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/role_assignments?user.id=3a2cdcb4d9ed4df38008f65cfceaa883&scope.system=all&role.id=b349f604875646c88269f9a8664c03b4 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:28.007780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:28.133704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1808-6890-4735-bbec-e643507e7aaa None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.146940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:28.157576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8c029-b658-496f-9a8f-54aa48a368f7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.175528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.175759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.176032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.176308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.188659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:28.196727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:28.198281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:28.199192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 178/367] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:28.203977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:28.215469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:28.266672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.267571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.268014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.268436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.269298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:28.269770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:28.271360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:28.289980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 190/368] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:28.291132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:28.333078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a07c1d-6ddf-415b-b8cf-525649f97f39 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.374848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.375784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.376207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.376681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.379063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:28.380852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:28.383042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 179/369] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:28 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:28.388304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:28.425451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00037819-3060-40ed-b221-eb8cfe552674 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.445365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:28.469696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.470679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.471142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.471591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.472541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:28.473117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:28.474886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:28.485391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 191/370] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:28.486508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:28.521820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d316-5536-4c27-8fb9-de97814b5b87 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.550794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:28.576970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.578499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.579286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.579779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.623144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503513-b4ee-464f-80ff-93308c74a603 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.669505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.670099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.670385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.671750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.672765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:28.672953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:28.674246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:28.674378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:28.676483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 192/371] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:28 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:28.678164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:28.732068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:28.800743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d58fd-96d9-4aa2-926c-891d1e70eeec None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.810371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 180/372] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:28.811271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:28.830318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:28.858952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.859977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.860457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.860944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.943423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb311418-bd3d-4ac7-9215-3d2afe7f2dbd None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:28.951577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:28.953165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:28.987314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:28.988312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:28.988735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:28.989177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:28.990312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=d76132606c2f4c478b357eba945315f1) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:28.991340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:28.993149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:29.003892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 181/373] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:28 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:29.005496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:29.009181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:29.111431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 193/374] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:29.115351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:29.134819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:29.173230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820735-3229-4cde-bc59-9be8e1bdbb77 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:29.259180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cca37c-ca05-4e3d-9ec9-5b57b34785a7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:29.260365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:29.261060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.261344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.261620 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.268823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:29.270009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:29.271836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 182/375] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:29.278437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:29.303688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:29.304631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.305050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.305528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] PATH_INFO: `/v3/projects/7b5d9225d0fd499a885320253a91a4b0` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.307068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] RBAC: Authorizing `identity:get_project(project_id=7b5d9225d0fd499a885320253a91a4b0)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:29.308721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:29.311602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 194/376] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/projects/7b5d9225d0fd499a885320253a91a4b0 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:29.318021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:29.421343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:29.427427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:29.440015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d7332-8ca4-4a1b-a974-3096d2d73edb None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:29.463295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef94b2-f3ca-411d-a3df-a4df435bbe86 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:29.489487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:29.490403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.490926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.491352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] PATH_INFO: `/v3/groups/a80859c373cc45979b0e59c393caf175` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.498400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] RBAC: Authorizing `identity:get_group(group_id=a80859c373cc45979b0e59c393caf175)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:29.500185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:29.502338 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 195/377] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/groups/a80859c373cc45979b0e59c393caf175 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:29.507640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:29.507640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.507640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.507640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.509007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:29.509172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:29.515653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:29.515653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 183/378] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:29.518460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:29.622647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94fc9-276d-4c82-aa21-fd3a10e63ae3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:29.651717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0dcb6-0090-457e-90c8-d81e0c0da3df None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:29.667895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dff33e-7dd7-4436-86c5-d683fa12da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:29.668627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff33e-7dd7-4436-86c5-d683fa12da3b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.668982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff33e-7dd7-4436-86c5-d683fa12da3b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.669329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff33e-7dd7-4436-86c5-d683fa12da3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.670196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dff33e-7dd7-4436-86c5-d683fa12da3b None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=d76132606c2f4c478b357eba945315f1) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:29.670579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dff33e-7dd7-4436-86c5-d683fa12da3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:29.672619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dff33e-7dd7-4436-86c5-d683fa12da3b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:29.678992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 184/379] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:29.685365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556170-b7fa-46b1-89ac-90a74d3edd85 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.685717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556170-b7fa-46b1-89ac-90a74d3edd85 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.686059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556170-b7fa-46b1-89ac-90a74d3edd85 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.687882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 185/380] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:29.694410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885135-4482-4735-9b60-74c96291d5d2 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.694838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885135-4482-4735-9b60-74c96291d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.695223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885135-4482-4735-9b60-74c96291d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.695359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:29.696259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.696678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.697085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.698371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] RBAC: Adding query filter params (group.id=a80859c373cc45979b0e59c393caf175, role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=7b5d9225d0fd499a885320253a91a4b0) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:29.698925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:29.700550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:29.707711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 196/381] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/role_assignments?group.id=a80859c373cc45979b0e59c393caf175&scope.project.id=7b5d9225d0fd499a885320253a91a4b0&role.id=af3b62eec1004adc904a4c278710faee => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:29.708058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:29.722735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-32885135-4482-4735-9b60-74c96291d5d2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:29.724041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-32885135-4482-4735-9b60-74c96291d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:29.805714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 186/382] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:29.830168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:29.840213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec094dc-ac4a-4f86-8c6e-eb87298cff0c None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.840602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec094dc-ac4a-4f86-8c6e-eb87298cff0c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.840954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec094dc-ac4a-4f86-8c6e-eb87298cff0c None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.843545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 187/383] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:29.846586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:29.852461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c77a5-21d9-4e43-9abf-fcf34c03b0b0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:29.852740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c77a5-21d9-4e43-9abf-fcf34c03b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:29.853025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c77a5-21d9-4e43-9abf-fcf34c03b0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:29.879274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1d2c77a5-21d9-4e43-9abf-fcf34c03b0b0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:29.881277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1d2c77a5-21d9-4e43-9abf-fcf34c03b0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:29.969028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc51f-dbac-4b27-9ac2-027b8d991935 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:29.970130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 188/384] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:29.993173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c77a5-21d9-4e43-9abf-fcf34c03b0b0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.009842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.010518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.010800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.011071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.027306 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:30.036543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:30.038267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:30.041851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 197/385] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:30.051649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.067883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:30.108922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c77a5-21d9-4e43-9abf-fcf34c03b0b0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.146040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.146705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.146986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.147655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.159400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:30.164592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:30.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:30.168841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 189/386] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:30.174735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.213118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:30.277658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1807d-10cd-4d1c-8748-8ca10d688cc7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.312779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743c45-8bbb-4f7c-97c8-a3d2930f86c8 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.338381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:30.351756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.352490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.352773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.353048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.353776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:30.354080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:30.355493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:30.356948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.357603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.357902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.358179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.358905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:30.359214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:30.360622 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:30.364716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 190/387] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:30.370346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.371802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 198/388] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:30.377464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.561525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21670f96-ad02-4f6e-b168-181191d547ee None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.574380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcefe6-692a-4bc3-b7f3-a6ada0321845 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.594433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:30.601125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.602497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.603317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.608494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.609994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:30.612018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:30.614250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 199/389] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:30 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:30.621862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.662655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.664223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.664966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.665697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.668135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:30.671256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:30.674805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 191/390] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:30 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:30.688349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.760966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4b46-3fe4-4b57-8168-68d671b68650 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.805697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.806579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.806959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.807330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.808943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:30.810989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:30.813294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 200/391] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:30 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:30.822848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.826927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:30.919285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:30.933572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484d2d8-6349-4455-bfd0-b38726afd7c4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.961508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6da25-5503-464b-b952-da6a2103b64e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.995103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.995830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.996077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.996353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.999810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292bbc4-2125-43ae-8511-75cc2133f856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.000339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.000519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292bbc4-2125-43ae-8511-75cc2133f856 None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.000767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292bbc4-2125-43ae-8511-75cc2133f856 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.001049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292bbc4-2125-43ae-8511-75cc2133f856 None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/groups/64ac3ab28812406ebad05367181e8ee4/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.001827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.002973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292bbc4-2125-43ae-8511-75cc2133f856 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d6dd272094584be1ba22fa4ea9281, group_id=64ac3ab28812406ebad05367181e8ee4, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.003889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 192/392] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:30 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:31.004419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292bbc4-2125-43ae-8511-75cc2133f856 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.009802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.039341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 201/393] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Jul 28 06:19:30 2022] PUT /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/groups/64ac3ab28812406ebad05367181e8ee4/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:31.134094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d224f-cf85-42e6-8979-b99ba94ba7cb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.155231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:31.170048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3f4a8-6d88-4ae1-aace-a2d715ac16ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.170657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3f4a8-6d88-4ae1-aace-a2d715ac16ba None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.170942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3f4a8-6d88-4ae1-aace-a2d715ac16ba None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.171218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3f4a8-6d88-4ae1-aace-a2d715ac16ba None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/groups/64ac3ab28812406ebad05367181e8ee4/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.173612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3f4a8-6d88-4ae1-aace-a2d715ac16ba None admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d6dd272094584be1ba22fa4ea9281, group_id=64ac3ab28812406ebad05367181e8ee4, role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.175105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3f4a8-6d88-4ae1-aace-a2d715ac16ba None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.194017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 193/394] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Jul 28 06:19:31 2022] PUT /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281/groups/64ac3ab28812406ebad05367181e8ee4/roles/fdf4549fa310408a94a78961b0a3fabc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:32.050022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184d22-dfa3-444f-9dad-c88b63fdf68d None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.050574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184d22-dfa3-444f-9dad-c88b63fdf68d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.050656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184d22-dfa3-444f-9dad-c88b63fdf68d None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.052038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 202/395] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:32.057364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259c2b-622a-4bbc-a61e-5b9299102351 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.057651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259c2b-622a-4bbc-a61e-5b9299102351 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.057923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259c2b-622a-4bbc-a61e-5b9299102351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.082855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-22259c2b-622a-4bbc-a61e-5b9299102351 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:32.084111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-22259c2b-622a-4bbc-a61e-5b9299102351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:32.171142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 194/396] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:32.208682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184d22-dfa3-444f-9dad-c88b63fdf68d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.344467 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184d22-dfa3-444f-9dad-c88b63fdf68d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.377909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:32.386226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d2c8f-298a-4721-847d-2f60c0ec7abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.386888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2c8f-298a-4721-847d-2f60c0ec7abe None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.387167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2c8f-298a-4721-847d-2f60c0ec7abe None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.387437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2c8f-298a-4721-847d-2f60c0ec7abe None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.398738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d2c8f-298a-4721-847d-2f60c0ec7abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-1e2d2c8f-298a-4721-847d-2f60c0ec7abe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:32.403709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:32.404555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:32.405487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 203/397] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:32.410834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22259c2b-622a-4bbc-a61e-5b9299102351 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.556243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22259c2b-622a-4bbc-a61e-5b9299102351 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.570680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:32.589440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378279a7-6cbd-4425-9404-c5f0e83ae78f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.589820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378279a7-6cbd-4425-9404-c5f0e83ae78f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.590195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378279a7-6cbd-4425-9404-c5f0e83ae78f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.591975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 204/398] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:32.601465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54a27-242d-45a5-85ca-cfc33d851244 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.601679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.601855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54a27-242d-45a5-85ca-cfc33d851244 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.601995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54a27-242d-45a5-85ca-cfc33d851244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.602980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.603509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.603861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.604606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] RBAC: Adding query filter params (name=member) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:32.604914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:32.606391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:32.623803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d2e54a27-242d-45a5-85ca-cfc33d851244 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:32.626171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d2e54a27-242d-45a5-85ca-cfc33d851244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:32.628164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 195/399] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:32.634073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.702954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 205/400] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:32.726848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e54a27-242d-45a5-85ca-cfc33d851244 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.866203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e2302-5bd4-46af-aa33-cfbeb5be0c33 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.869585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e54a27-242d-45a5-85ca-cfc33d851244 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.902151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:32.924581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15583e56-2301-49c5-be66-a79989a9e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.925591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583e56-2301-49c5-be66-a79989a9e745 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.926061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583e56-2301-49c5-be66-a79989a9e745 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.926540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583e56-2301-49c5-be66-a79989a9e745 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.926640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5173c9-4712-49ce-ae9d-47859efed8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.927264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5173c9-4712-49ce-ae9d-47859efed8ea None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.927542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5173c9-4712-49ce-ae9d-47859efed8ea None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.927915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5173c9-4712-49ce-ae9d-47859efed8ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.928689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15583e56-2301-49c5-be66-a79989a9e745 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:32.930558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15583e56-2301-49c5-be66-a79989a9e745 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:32.932710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 196/401] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:32.934114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902fe5a-0322-48f1-ae71-1c01925f2f2c None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.934692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902fe5a-0322-48f1-ae71-1c01925f2f2c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.935163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902fe5a-0322-48f1-ae71-1c01925f2f2c None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.940943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5173c9-4712-49ce-ae9d-47859efed8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:32.941400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 197/402] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:32.942355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902fe5a-0322-48f1-ae71-1c01925f2f2c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-cb5173c9-4712-49ce-ae9d-47859efed8ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:32.943256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:32.944137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:32.945320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 206/403] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:32.946112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee00b-90c5-40f5-b346-2fbe8260df76 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.946177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee00b-90c5-40f5-b346-2fbe8260df76 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.946492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee00b-90c5-40f5-b346-2fbe8260df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.977484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-507ee00b-90c5-40f5-b346-2fbe8260df76 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:32.979317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-507ee00b-90c5-40f5-b346-2fbe8260df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:32.999572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:33.057552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 207/404] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:33.064057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902fe5a-0322-48f1-ae71-1c01925f2f2c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.065271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee00b-90c5-40f5-b346-2fbe8260df76 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.095393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.096086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.096363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.096875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.097790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.101254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.101254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 198/405] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:33.106989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.201364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee00b-90c5-40f5-b346-2fbe8260df76 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.209544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:33.243749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.244745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.245266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.245553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c053a7-94fc-4403-9139-8c056de62950 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.245976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.246928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:33.247422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.249048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.256572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:33.258958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 208/406] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:33.260368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.289386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.290281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.290569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.290850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1/groups/64ac3ab28812406ebad05367181e8ee4/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.293756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76132606c2f4c478b357eba945315f1, group_id=64ac3ab28812406ebad05367181e8ee4, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.295488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.312892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 199/407] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Jul 28 06:19:33 2022] PUT /identity/v3/projects/d76132606c2f4c478b357eba945315f1/groups/64ac3ab28812406ebad05367181e8ee4/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:33.315739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.434736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9fc6c-ea0e-4e2d-b19c-0a7635029a5b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.519139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca196-cbc9-4242-9a36-0727ffbb2531 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.520421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.521103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.521388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.521667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.545484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:33.550971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:33.551891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:33.553269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 209/408] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:33.558414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.568952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.569980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.570472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.571483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.573663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.575379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.577901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 200/409] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:33 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:33.583376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.608593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:33.621651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:33.688059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da23bc-dcf3-4ef8-a6d4-3b3fb2f8a349 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.690608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea81de8-71e5-4ad5-a251-472b5ca25ade None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.723129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.723947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.724279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.724555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.725270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:33.725428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ca5df-ea9a-43b9-ac99-439323bcafa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.725627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.726037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca5df-ea9a-43b9-ac99-439323bcafa7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.726319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca5df-ea9a-43b9-ac99-439323bcafa7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.726594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca5df-ea9a-43b9-ac99-439323bcafa7 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.726952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.727934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ca5df-ea9a-43b9-ac99-439323bcafa7 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.729413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ca5df-ea9a-43b9-ac99-439323bcafa7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.736163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 201/410] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:33 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:33.736163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001173d-8071-4103-90bf-af63d9129286 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.736163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001173d-8071-4103-90bf-af63d9129286 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.736163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001173d-8071-4103-90bf-af63d9129286 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.736163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 202/411] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:33.736163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b1fe-76af-4dfd-96ef-c510655d996f None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.736598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b1fe-76af-4dfd-96ef-c510655d996f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.736598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b1fe-76af-4dfd-96ef-c510655d996f None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.736909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 203/412] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:33.739959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81ab9-6734-41ec-8a6c-87885e3e504b None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.739959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81ab9-6734-41ec-8a6c-87885e3e504b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.739959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81ab9-6734-41ec-8a6c-87885e3e504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.742563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 210/413] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:33.743897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.759320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-99c81ab9-6734-41ec-8a6c-87885e3e504b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:33.760553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-99c81ab9-6734-41ec-8a6c-87885e3e504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:33.829564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 204/414] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:33.831210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8028e-04d2-4af6-9f54-2f0859738a9e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.831564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8028e-04d2-4af6-9f54-2f0859738a9e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.831934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8028e-04d2-4af6-9f54-2f0859738a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.850450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:33.857004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b0f8028e-04d2-4af6-9f54-2f0859738a9e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:33.858190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b0f8028e-04d2-4af6-9f54-2f0859738a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:33.863271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1c5ec-074b-4a4c-815e-6e8beb126804 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.885693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:33.901356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.902497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.902979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.903474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1/groups/64ac3ab28812406ebad05367181e8ee4/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.906222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] RBAC: Authorizing `identity:create_grant(project_id=d76132606c2f4c478b357eba945315f1, group_id=64ac3ab28812406ebad05367181e8ee4, role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.907758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.923706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 211/415] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Jul 28 06:19:33 2022] PUT /identity/v3/projects/d76132606c2f4c478b357eba945315f1/groups/64ac3ab28812406ebad05367181e8ee4/roles/fdf4549fa310408a94a78961b0a3fabc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:33.924433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.945010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 205/416] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:33.947654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8028e-04d2-4af6-9f54-2f0859738a9e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.046021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997782f-b398-4772-8d7c-310fdb3a104c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.082764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8028e-04d2-4af6-9f54-2f0859738a9e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.085071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.086366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.086950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.087429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] PATH_INFO: `/v3/groups/a80859c373cc45979b0e59c393caf175` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.088998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] RBAC: Authorizing `identity:get_group(group_id=a80859c373cc45979b0e59c393caf175)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.090782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.092755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 212/417] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:33 2022] GET /identity/v3/groups/a80859c373cc45979b0e59c393caf175 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:34.093963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.117364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.126796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.127575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.127893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.128171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.141734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:34.147009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:34.147940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:34.148725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 206/418] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:34.150275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.181241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.234067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885d30f-1949-4154-a835-ba0d360bf88e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.263633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df1781-726d-4cf6-a006-a2e7949a9e8d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.283449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.284281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.284915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.285191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.300767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:34.302891 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.303704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.304079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.304800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] PATH_INFO: `/v3/projects/7b5d9225d0fd499a885320253a91a4b0` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.306145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] RBAC: Authorizing `identity:get_project(project_id=7b5d9225d0fd499a885320253a91a4b0)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:34.306810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:34.308804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:34.310749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:34.312162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.312286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 213/419] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:34.314552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.314748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 207/420] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/projects/7b5d9225d0fd499a885320253a91a4b0 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:34.320839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.413264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.424316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.436964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f752-5cb6-4b61-a441-8405f3e7fa6e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.439243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a2d76-5aca-4dba-a85e-7402c2fc33b3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.476794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.477842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.478118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.478387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.479099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:34.479401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.480865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.483084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.483897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.484247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.484593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] PATH_INFO: `/v3/projects/7b5d9225d0fd499a885320253a91a4b0/groups/a80859c373cc45979b0e59c393caf175/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.486789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d9225d0fd499a885320253a91a4b0, group_id=a80859c373cc45979b0e59c393caf175, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.488342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.495381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 214/421] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:34.496738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.515779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 208/422] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Jul 28 06:19:34 2022] PUT /identity/v3/projects/7b5d9225d0fd499a885320253a91a4b0/groups/a80859c373cc45979b0e59c393caf175/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:34.515779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.704648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d83343-79c9-40a2-8b25-a408393ce913 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.708824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6872689-9925-43e7-b31d-279283935de3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.750035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.751166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.752179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.752754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.754295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.755117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.755400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.755709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.756429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:34.756793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.759551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.775059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 215/423] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:34.776970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.779611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.784504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.859957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.861517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.882379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5c22-c4c1-4330-984e-da61d7a597a7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.924063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.925074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.925563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.926043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.995449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 209/424] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:34.997828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.999516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.001097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.001866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:35.070270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:35.107550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 216/425] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 06:19:35.113765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.121945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629df26-2d72-4717-9fd2-78eb4dad103e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.159302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.160004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.160287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.160621 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.161710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.163332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.165590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 210/426] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:35.171004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.221652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017ad44-9315-4501-8f51-2ad81e4e3c8b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.223574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:35.258331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.259357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.259858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.260328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] PATH_INFO: `/v3/projects/2b7d6dd272094584be1ba22fa4ea9281` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.261704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] RBAC: Authorizing `identity:get_project(project_id=2b7d6dd272094584be1ba22fa4ea9281)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.263353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.265591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 217/427] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/projects/2b7d6dd272094584be1ba22fa4ea9281 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:35.271220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.281537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774a17-417d-4033-929c-1c639c9183bb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.304556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:35.321757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.322932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.323199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.323475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.324900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.326352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.328806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 211/428] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:35.334768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.380420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78df1e-2c1e-4e0a-96b9-fede295c17ac None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.415964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.416989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.417490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.417960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.419318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.420991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.423121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 218/429] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:35.432617 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.442262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806909ed-8216-4928-81cc-51aba0d1fc22 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.478973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02963-e6a5-40bc-8782-415e2dd8c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.479610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02963-e6a5-40bc-8782-415e2dd8c1ba None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.479935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02963-e6a5-40bc-8782-415e2dd8c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.480206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02963-e6a5-40bc-8782-415e2dd8c1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.480995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc02963-e6a5-40bc-8782-415e2dd8c1ba None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:35.481413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc02963-e6a5-40bc-8782-415e2dd8c1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.482921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc02963-e6a5-40bc-8782-415e2dd8c1ba None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.489674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 212/430] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:35.527107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:35.535010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff990-1cb7-45df-8a02-781c856e47f4 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.535344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff990-1cb7-45df-8a02-781c856e47f4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.535645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff990-1cb7-45df-8a02-781c856e47f4 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.537117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 213/431] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:35.542489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf770c-b1e6-4d36-a94f-5c854ad2515c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.542772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf770c-b1e6-4d36-a94f-5c854ad2515c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.543065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf770c-b1e6-4d36-a94f-5c854ad2515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.572020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-fdbf770c-b1e6-4d36-a94f-5c854ad2515c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:35.573132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-fdbf770c-b1e6-4d36-a94f-5c854ad2515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:35.604227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ccfce-9883-4c4c-a0be-2d3a2dafe98e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.623901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:35.646075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.647088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.647574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.648237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.649273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=2b7d6dd272094584be1ba22fa4ea9281) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:35.649795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.650308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 214/432] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:35.656062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.663809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 219/433] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=2b7d6dd272094584be1ba22fa4ea9281&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:35.683257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf770c-b1e6-4d36-a94f-5c854ad2515c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.803109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf770c-b1e6-4d36-a94f-5c854ad2515c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.850895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.851558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.851880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.852413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.863284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:35.868329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:35.869198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:35.870007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 215/434] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:35.875536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.991421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8baa23-227c-4805-a2be-a7d3421e949d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.993141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.027407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.028100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.028388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.028663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.029448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] RBAC: Adding query filter params (name=member) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:36.029766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.031145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.040759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 220/435] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:36.046566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.098930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.157033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7204f-711a-4802-aa5e-953f35f971cd None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.192061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c0617-a24b-42b1-b240-468dfd020a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.192699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c0617-a24b-42b1-b240-468dfd020a0e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.192981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c0617-a24b-42b1-b240-468dfd020a0e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.193602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c0617-a24b-42b1-b240-468dfd020a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.263720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c0617-a24b-42b1-b240-468dfd020a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.265194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c0617-a24b-42b1-b240-468dfd020a0e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.308234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.374310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 216/436] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:36.379745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.452075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909232c-ffa5-49c0-aa26-eec5988db6d8 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.452310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909232c-ffa5-49c0-aa26-eec5988db6d8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.452619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909232c-ffa5-49c0-aa26-eec5988db6d8 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.454154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 217/437] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:36.459008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9281b2-6cc8-4904-893f-37fb5e9f5b74 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.459263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9281b2-6cc8-4904-893f-37fb5e9f5b74 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.459570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9281b2-6cc8-4904-893f-37fb5e9f5b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.481077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cc9281b2-6cc8-4904-893f-37fb5e9f5b74 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:36.482366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cc9281b2-6cc8-4904-893f-37fb5e9f5b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:36.484203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0250ac-1d0d-4bfc-b0bc-40af3a4b4a68 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.519886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.520539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.520815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.521089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.522263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.523730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.525389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 221/438] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:36.530800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.556396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 218/439] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:36.564006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.579147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9281b2-6cc8-4904-893f-37fb5e9f5b74 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.637741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d371078-0bc8-469d-8c70-fc6a706d0630 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.665085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.675672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.676770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.677223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.677641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.679556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.681701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.684173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 222/440] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:36.689812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.699342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9281b2-6cc8-4904-893f-37fb5e9f5b74 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.737798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.738460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.738745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.739022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.750084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:36.755170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:36.756300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:36.757220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 219/441] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:36.762108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.804399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.807593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a69c0-b35b-4fba-914c-ffa4257f0804 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.846505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.847214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.847499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.847816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.848599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=d02524abaa4649c8bd246eac91a4f773, scope.project.id=d76132606c2f4c478b357eba945315f1) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:36.848906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.850342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.867722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 223/442] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=d02524abaa4649c8bd246eac91a4f773 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:36.867935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a22693-8ea7-47b5-9f53-a7cbfa7456c6 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.899160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.905029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5a5f4-984c-4bb7-bc5f-7b70da152947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.905680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5a5f4-984c-4bb7-bc5f-7b70da152947 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.905968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5a5f4-984c-4bb7-bc5f-7b70da152947 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.906244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5a5f4-984c-4bb7-bc5f-7b70da152947 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.906983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5a5f4-984c-4bb7-bc5f-7b70da152947 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:36.907293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5a5f4-984c-4bb7-bc5f-7b70da152947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.908787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5a5f4-984c-4bb7-bc5f-7b70da152947 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.918817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 220/443] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:36.924375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.955859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fb67f-16af-4b01-9826-42717123a4fd None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.956187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fb67f-16af-4b01-9826-42717123a4fd None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.956422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fb67f-16af-4b01-9826-42717123a4fd None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.958023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 221/444] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:36.963833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42243a0e-6ed0-43bd-a2ba-0f587e6280a2 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.964179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42243a0e-6ed0-43bd-a2ba-0f587e6280a2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.964396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42243a0e-6ed0-43bd-a2ba-0f587e6280a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.983769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-42243a0e-6ed0-43bd-a2ba-0f587e6280a2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:36.985005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-42243a0e-6ed0-43bd-a2ba-0f587e6280a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:37.052494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bcf13-63bb-461c-a767-133f2e87edd4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.065384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 222/445] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:37.087893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42243a0e-6ed0-43bd-a2ba-0f587e6280a2 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.096826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.097474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.097764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.098039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.134579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.177714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.179231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.202034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42243a0e-6ed0-43bd-a2ba-0f587e6280a2 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.231916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.246962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.247635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.247934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.248209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.258535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:37.263485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:37.264522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:37.265304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 223/446] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:37.270478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.290954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 224/447] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 06:19:37.296596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.357233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.366476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5169-6f77-479f-86be-9eb8d3d12f56 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.395463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5f7c4-0104-4c9a-a7c5-d774dab2eba9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.400321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.400945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.401224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.401503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.402219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:37.402517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.403989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.412202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 224/448] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:37.417741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.431093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.431810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.432089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.432361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] PATH_INFO: `/v3/projects/d76132606c2f4c478b357eba945315f1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.433560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] RBAC: Authorizing `identity:get_project(project_id=d76132606c2f4c478b357eba945315f1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.434991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.436839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 225/449] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/projects/d76132606c2f4c478b357eba945315f1 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:37.442123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.464579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.519314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22730-b003-410a-a715-26aaf0e707b4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.539687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0a300-1977-4a8e-84d2-13026b593dfd None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.551768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.552396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.552679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.552949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.568519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.574412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.575061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.575345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.575635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] PATH_INFO: `/v3/groups/64ac3ab28812406ebad05367181e8ee4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.576846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] RBAC: Authorizing `identity:get_group(group_id=64ac3ab28812406ebad05367181e8ee4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.578279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.580078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 226/450] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/groups/64ac3ab28812406ebad05367181e8ee4 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:37.585687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.619099 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.620594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.663997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.682446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f0d9-2dfe-4d98-b867-a4dc9d8f80bd None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.716565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.716867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 225/451] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 06:19:37.720167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.720445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.720717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.721579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] RBAC: Adding query filter params (group.id=64ac3ab28812406ebad05367181e8ee4, role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=d76132606c2f4c478b357eba945315f1) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:37.721888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.722375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.723315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.729148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 227/452] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/role_assignments?group.id=64ac3ab28812406ebad05367181e8ee4&scope.project.id=d76132606c2f4c478b357eba945315f1&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:37.828895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5502-35ae-4981-85a5-080c705e3d0c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.865711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.866384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.866656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.866934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] PATH_INFO: `/v3/projects/7b5d9225d0fd499a885320253a91a4b0` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.868217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] RBAC: Authorizing `identity:get_project(project_id=7b5d9225d0fd499a885320253a91a4b0)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.869678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.871385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 226/453] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/projects/7b5d9225d0fd499a885320253a91a4b0 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:37.877088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.944460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.986093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037137d2-d2aa-4d22-81db-c4cdab55ae77 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:38.019376 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b88bb-e147-4b19-ae8d-f491ed867dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:38.020068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b88bb-e147-4b19-ae8d-f491ed867dde None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:38.020355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b88bb-e147-4b19-ae8d-f491ed867dde None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:38.020626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b88bb-e147-4b19-ae8d-f491ed867dde None admin] PATH_INFO: `/v3/groups/a80859c373cc45979b0e59c393caf175` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:38.021812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b88bb-e147-4b19-ae8d-f491ed867dde None admin] RBAC: Authorizing `identity:get_group(group_id=a80859c373cc45979b0e59c393caf175)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:38.025169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b88bb-e147-4b19-ae8d-f491ed867dde None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:38.025169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 228/454] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/groups/a80859c373cc45979b0e59c393caf175 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:38.030962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:38.048108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:38.134568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ce69-9063-41c0-a2d3-02477b953352 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:38.176073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f846a7-297d-4663-b30c-0a0bed59d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:38.176687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f846a7-297d-4663-b30c-0a0bed59d16d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:38.176964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f846a7-297d-4663-b30c-0a0bed59d16d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:38.177245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f846a7-297d-4663-b30c-0a0bed59d16d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:38.178029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f846a7-297d-4663-b30c-0a0bed59d16d None admin] RBAC: Adding query filter params (group.id=a80859c373cc45979b0e59c393caf175, role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=7b5d9225d0fd499a885320253a91a4b0) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:38.178335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f846a7-297d-4663-b30c-0a0bed59d16d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:38.179815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f846a7-297d-4663-b30c-0a0bed59d16d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:38.186321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 227/455] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Jul 28 06:19:38 2022] GET /identity/v3/role_assignments?group.id=a80859c373cc45979b0e59c393caf175&scope.project.id=7b5d9225d0fd499a885320253a91a4b0&role.id=af3b62eec1004adc904a4c278710faee => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:40.516299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddffa6-46cf-462c-a514-a6840e5f9ab2 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:40.516299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddffa6-46cf-462c-a514-a6840e5f9ab2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:40.516299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddffa6-46cf-462c-a514-a6840e5f9ab2 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:40.517437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 229/456] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:40.523427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fcd5d-937f-4eb3-971d-a6a7e023c957 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:40.524321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fcd5d-937f-4eb3-971d-a6a7e023c957 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:40.524791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fcd5d-937f-4eb3-971d-a6a7e023c957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:40.552616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-c57fcd5d-937f-4eb3-971d-a6a7e023c957 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:40.554156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c57fcd5d-937f-4eb3-971d-a6a7e023c957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:40.649931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 228/457] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:40.698292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddffa6-46cf-462c-a514-a6840e5f9ab2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:40.760783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483af99-b8bb-4d60-acc9-4b7900f7a1fc None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:40.761455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483af99-b8bb-4d60-acc9-4b7900f7a1fc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:40.761949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483af99-b8bb-4d60-acc9-4b7900f7a1fc None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:40.763506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 229/458] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:40.772402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86de7-9af5-42a6-9dc5-1dae994f4a46 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:40.772922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86de7-9af5-42a6-9dc5-1dae994f4a46 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:40.773388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86de7-9af5-42a6-9dc5-1dae994f4a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:40.799555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-98c86de7-9af5-42a6-9dc5-1dae994f4a46 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:40.804967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-98c86de7-9af5-42a6-9dc5-1dae994f4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:40.808273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:40.830220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddffa6-46cf-462c-a514-a6840e5f9ab2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:40.867032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:40.876501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:40.877357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:40.877780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:40.878286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:40.879959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 230/459] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:40.888996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1567b-6840-4378-b38b-a4e5e0f9dc3a None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:40.889250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:40.889619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1567b-6840-4378-b38b-a4e5e0f9dc3a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:40.890036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1567b-6840-4378-b38b-a4e5e0f9dc3a None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:40.890707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:40.891831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 231/460] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:40.897492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e209-c761-4cee-80bd-168c6946d2c3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:40.897920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e209-c761-4cee-80bd-168c6946d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:40.898333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e209-c761-4cee-80bd-168c6946d2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:40.910220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:40.911282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:40.912326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:40.912326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:40.912326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:40.912326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:40.914384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 230/461] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:40.917546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:40.931289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-9ca1e209-c761-4cee-80bd-168c6946d2c3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:40.932614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9ca1e209-c761-4cee-80bd-168c6946d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:41.001276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 232/462] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:41.002548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1e209-c761-4cee-80bd-168c6946d2c3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.024757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2911e0a-61ae-4988-8331-ee7cc0032790 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.063157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.064181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.064649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.065096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.071196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:41.077223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.078999 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:41.094293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:41.095155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:41.096038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:41.096038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:41.096038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:41.096038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:41.098234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 231/463] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:41.103965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.108005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1e209-c761-4cee-80bd-168c6946d2c3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.140824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:41.144008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.144804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.145220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.145824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.146690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:41.147119 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.148812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.160977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 233/464] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:41.162540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.213541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5434b1c-4d6c-4850-a9fc-20008d461c1d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.249595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.250641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.251114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.251599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.265722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.267503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.272753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e4b9b-a6de-4422-8b03-cd8ff798816b None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:41.282902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:41.283787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:41.284633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:41.284633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:41.284633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:41.284633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:41.286938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 232/465] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:41.287986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.300367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:41.309225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.310157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.311301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.311763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.312591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:41.313056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.314585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.327662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 234/466] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:41.329012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.388373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:41.401930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8026864-e0d8-445a-b9b7-7c73190eb600 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.430591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc549d-e81f-482c-acc6-a8f64d4b1102 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.437151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.437891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.438268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.438641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.439414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.440998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.470556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 233/467] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:41 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:41.471524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.480749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.481413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.481689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.482023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.482739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:41.483042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.484524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.505008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 235/468] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:41.510659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.591753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:41.594234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fcc0a-aea6-4375-8a06-2469c6afa09b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.632755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f18923-8298-4934-a170-5b85dc7bce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.633880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f18923-8298-4934-a170-5b85dc7bce21 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.634355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f18923-8298-4934-a170-5b85dc7bce21 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.634865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f18923-8298-4934-a170-5b85dc7bce21 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.635791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f18923-8298-4934-a170-5b85dc7bce21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.637485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f18923-8298-4934-a170-5b85dc7bce21 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.651370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18122-7052-4174-8b81-8fbfc17e03cf None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.657289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:41.664039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 234/469] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:41 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:41.665956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888635d-67a2-487e-90a1-b8552c4e17d4 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.666521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888635d-67a2-487e-90a1-b8552c4e17d4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.667009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888635d-67a2-487e-90a1-b8552c4e17d4 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.673230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 235/470] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:41.675669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3da6e-c55a-4608-af49-91bef70139c5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.676257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3da6e-c55a-4608-af49-91bef70139c5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.676532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3da6e-c55a-4608-af49-91bef70139c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.698518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e4e3da6e-c55a-4608-af49-91bef70139c5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:41.700472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e4e3da6e-c55a-4608-af49-91bef70139c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:41.764447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.765069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.765356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.765635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.766329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.767822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.783776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 236/471] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:41.807109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3da6e-c55a-4608-af49-91bef70139c5 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.807714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 236/472] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:41 2022] POST /identity/v3/users => generated 248 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:19:41.931535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3da6e-c55a-4608-af49-91bef70139c5 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.964838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:41.971688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f61eb-9553-4bac-a73e-8687268d07a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.972365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f61eb-9553-4bac-a73e-8687268d07a3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.972644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f61eb-9553-4bac-a73e-8687268d07a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.972915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f61eb-9553-4bac-a73e-8687268d07a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.984311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f61eb-9553-4bac-a73e-8687268d07a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.985805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f61eb-9553-4bac-a73e-8687268d07a3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-964f61eb-9553-4bac-a73e-8687268d07a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:42.001644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:42.002522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:42.003514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:42.003514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:42.003514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:42.003514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:42.003514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 237/473] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:42.009786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.138963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c321ba-5c35-4ebd-ae86-382b89f26493 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:42.141375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:42.176867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:42.177506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.177786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.178058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.178762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:42.179062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:42.180609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:42.191986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf8dfb-44ec-41a6-b3d3-221ce2c09ad1 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.192244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf8dfb-44ec-41a6-b3d3-221ce2c09ad1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.192451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf8dfb-44ec-41a6-b3d3-221ce2c09ad1 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.193949 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 238/474] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:42.200167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 237/475] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:42.204165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e360-9d06-406e-9c13-db7b498bf3d0 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.204701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e360-9d06-406e-9c13-db7b498bf3d0 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.205163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e360-9d06-406e-9c13-db7b498bf3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.205486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.243094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-9f33e360-9d06-406e-9c13-db7b498bf3d0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:42.244343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9f33e360-9d06-406e-9c13-db7b498bf3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:42.335430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a419d-7a91-4e4c-a1f0-a329b921ae12 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:42.375005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 239/476] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:42.390207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:42.390840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.391122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.391398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.392120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:42.393565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:42.419153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 238/477] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:42 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:42.420678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33e360-9d06-406e-9c13-db7b498bf3d0 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.556296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33e360-9d06-406e-9c13-db7b498bf3d0 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:42.578755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:42.612234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:42.613736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.614288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.614798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.615709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:42.617259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:42.633498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.sql.core [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 06:19:42.633498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 06:19:42.633498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [parameters: {'id': 'cf14a9ce744643c7b442bc5b320f85f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 06:19:42.633498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89166) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application conn.query(q) Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result.read() Jul 28 06:19:42.655277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 06:19:42.656238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application next(self.gen) Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application yield resource Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application next(self.gen) Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise self.value Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application session.commit() Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 06:19:42.657136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.session.flush() Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application compat.raise_( Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 06:19:42.658063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 06:19:42.658925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application conn.query(q) Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result.read() Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 06:19:42.661081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [parameters: {'id': 'cf14a9ce744643c7b442bc5b320f85f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:42.662230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 06:19:42.663241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:42.666154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 240/478] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Jul 28 06:19:42 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:42.672896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.709961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:42.800516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3d63b-6073-4547-9684-61492e1fe7f5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:42.836377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160fcd-7582-42b8-b5f6-0815e4d80793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:42.837327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160fcd-7582-42b8-b5f6-0815e4d80793 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.837802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160fcd-7582-42b8-b5f6-0815e4d80793 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.838249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160fcd-7582-42b8-b5f6-0815e4d80793 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.849388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1160fcd-7582-42b8-b5f6-0815e4d80793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-d1160fcd-7582-42b8-b5f6-0815e4d80793 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:42.855074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:42.855988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 06:19:42.856786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:42.859094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 239/479] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:19:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:42.864913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.978100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287a32-fea1-4609-8f42-a3c3eb1b3e8f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.013944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a971bd-73df-4720-bc07-df023185c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.014889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a971bd-73df-4720-bc07-df023185c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.015346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a971bd-73df-4720-bc07-df023185c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.015822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a971bd-73df-4720-bc07-df023185c0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.016707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a971bd-73df-4720-bc07-df023185c0b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:43.017260 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a971bd-73df-4720-bc07-df023185c0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.018871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a971bd-73df-4720-bc07-df023185c0b3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.028275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 241/480] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:44.003204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78c5d-3ec6-4d7b-a6f7-3f7b618e02ce None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.004263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78c5d-3ec6-4d7b-a6f7-3f7b618e02ce None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.004809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78c5d-3ec6-4d7b-a6f7-3f7b618e02ce None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.006705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 240/481] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:44.011905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3f66-4c7e-4791-bfb4-a7042ef0537d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.012703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3f66-4c7e-4791-bfb4-a7042ef0537d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.013173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3f66-4c7e-4791-bfb4-a7042ef0537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.036792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-03af3f66-4c7e-4791-bfb4-a7042ef0537d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:44.038005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-03af3f66-4c7e-4791-bfb4-a7042ef0537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:44.082155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.133204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 242/482] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:44.161411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78c5d-3ec6-4d7b-a6f7-3f7b618e02ce None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.225631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f1d3f-72c0-4aa7-9246-5554667376bb None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.225631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f1d3f-72c0-4aa7-9246-5554667376bb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.225631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f1d3f-72c0-4aa7-9246-5554667376bb None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.226405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 243/483] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:44.236683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945266-f317-4eb1-988c-38c21160f4c3 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.237193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945266-f317-4eb1-988c-38c21160f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.237675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945266-f317-4eb1-988c-38c21160f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.265029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.266822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-30945266-f317-4eb1-988c-38c21160f4c3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:44.268237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-30945266-f317-4eb1-988c-38c21160f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:44.288942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78c5d-3ec6-4d7b-a6f7-3f7b618e02ce None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.356819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.357586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.358068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.358543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.382894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:44.388261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:44.389136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:44.390337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 241/484] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:44.397176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.418199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 244/485] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:44.419848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b262-329d-47da-9e54-7b7aaa628d81 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.420138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b262-329d-47da-9e54-7b7aaa628d81 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.420416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b262-329d-47da-9e54-7b7aaa628d81 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.421893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 245/486] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:44.426817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9c6f7-dcaf-49f0-b80e-a31ef80eca5d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.427057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9c6f7-dcaf-49f0-b80e-a31ef80eca5d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.427335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9c6f7-dcaf-49f0-b80e-a31ef80eca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.445211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-9cb9c6f7-dcaf-49f0-b80e-a31ef80eca5d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:44.446585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9cb9c6f7-dcaf-49f0-b80e-a31ef80eca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:44.517738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64946d7-6e44-4bc5-9cd2-e18afe11bf6d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.527754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 246/487] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:44.529186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9c6f7-dcaf-49f0-b80e-a31ef80eca5d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.565835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.566785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.567233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.567720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.568663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:44.569173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.570787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.571991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.585361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 242/488] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:44.587021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.590563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.647143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9c6f7-dcaf-49f0-b80e-a31ef80eca5d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.682097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.682857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.683143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.683418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.693965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:44.695306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8097-e782-4cd5-8e1c-9bb6bd3b450d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:44.699507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:44.700443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:44.701659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 247/489] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:44.702479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.736728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.737800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.738297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.738800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.751360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:44.758017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:44.759157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:44.759977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:44.762547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 243/490] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:44.763678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.800204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.821420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6688fd-c7c4-408f-87a6-ad1c0fcc9552 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.827088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.859878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.860815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.861233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.861642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.868852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65f06-ae40-4cdf-88dc-03670df0c441 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.873628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.875247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:44.891319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:44.892424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:44.893373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:44.893373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:44.893373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:44.893373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:44.895298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 248/491] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:44.896424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.908308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.908764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.909037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.909307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.910024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:44.910330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.911921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.920701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 244/492] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:44.921866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.006436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6048a2-9621-40bd-9c9e-035aaec5066d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.022031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33cb18-a6fc-4f45-9f31-42d166bb513b None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.045282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.046166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.047655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.048112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.048773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.049663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:45.051900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.051900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.057466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.058115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.058429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.058707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.059675 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:45.059781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.061205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.063499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 249/493] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:45.064687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.067702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.074999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 245/494] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:45.080279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.175845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7a2e1-f51b-4a37-b242-0ee588306863 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.180329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492f5a0-0068-4a5a-9293-2c2758c60642 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.214051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936169c-a717-4fbd-8884-28772aeb443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.215136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936169c-a717-4fbd-8884-28772aeb443a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.215242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.215781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936169c-a717-4fbd-8884-28772aeb443a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.215990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.216228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.216500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.216827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936169c-a717-4fbd-8884-28772aeb443a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.227176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.228650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.229310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936169c-a717-4fbd-8884-28772aeb443a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.231218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936169c-a717-4fbd-8884-28772aeb443a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:45.243312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:45.244251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:45.245191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:45.245191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:45.245191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:45.245191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:45.245191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 246/495] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:45.245822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-6936169c-a717-4fbd-8884-28772aeb443a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:45.247342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:45.248163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:45.248976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:45.248976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:45.248976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:45.248976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:45.248976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 250/496] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:45.250902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d390-c69c-418f-ad17-3877458ce74f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.251182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d390-c69c-418f-ad17-3877458ce74f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.251453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d390-c69c-418f-ad17-3877458ce74f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.256421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 251/497] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:45.256956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d390-c69c-418f-ad17-3877458ce74f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.290917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.320232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.362133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42b66-7ccd-4470-b2f5-0a16c54397d2 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.371440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d390-c69c-418f-ad17-3877458ce74f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.398721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.399610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.400066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.400338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] PATH_INFO: `/v3/users/nova` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.408406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.408701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45240666-84d5-4340-9336-a41b531ee153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.409373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45240666-84d5-4340-9336-a41b531ee153 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.409649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45240666-84d5-4340-9336-a41b531ee153 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.409881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.409976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45240666-84d5-4340-9336-a41b531ee153 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.410811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45240666-84d5-4340-9336-a41b531ee153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:45.411117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45240666-84d5-4340-9336-a41b531ee153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.412855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45240666-84d5-4340-9336-a41b531ee153 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:45.422953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:45.423942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:45.424843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 247/498] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:45.425411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.434292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 252/499] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:45.436358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e547-c512-4d49-a2b9-cb592336035d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.437139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e547-c512-4d49-a2b9-cb592336035d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.437433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e547-c512-4d49-a2b9-cb592336035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.456076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-12a9e547-c512-4d49-a2b9-cb592336035d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:45.457263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-12a9e547-c512-4d49-a2b9-cb592336035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:45.520598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.524869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 253/500] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:45.525728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9e547-c512-4d49-a2b9-cb592336035d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.527135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5f79-c902-4419-9316-cad03ef7d92b None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.560343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.560967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.561243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.561520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.562214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:45.562513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.563932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.576959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 248/501] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:45.577692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.579014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.632533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9e547-c512-4d49-a2b9-cb592336035d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.666411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72f77d-b23e-49f9-8449-e762405c1c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.667040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72f77d-b23e-49f9-8449-e762405c1c57 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.667315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72f77d-b23e-49f9-8449-e762405c1c57 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.667595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72f77d-b23e-49f9-8449-e762405c1c57 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.668426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72f77d-b23e-49f9-8449-e762405c1c57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:45.668719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72f77d-b23e-49f9-8449-e762405c1c57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.670168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72f77d-b23e-49f9-8449-e762405c1c57 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.674459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eda3b3-0c22-4735-a365-8254f621dda5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.705822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 254/502] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:45.707132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4df33-cf79-44b3-a0e2-ef28867bb67d None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.707422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4df33-cf79-44b3-a0e2-ef28867bb67d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.707712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4df33-cf79-44b3-a0e2-ef28867bb67d None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.709103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 255/503] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:45.709901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.710558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.710826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.711107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.712349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4df33-cf79-44b3-a0e2-ef28867bb67d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.719866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.721339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:45.733413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:45.734459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 249/504] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:45.735426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.753752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.816410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4df33-cf79-44b3-a0e2-ef28867bb67d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.818020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:45.835108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e3275-1941-4f86-b4d6-e027650523e0 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.850621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.851267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.851545 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.852099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.862308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:45.867352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:45.868555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 256/505] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:45.869455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.871396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c6c16-1c56-4df5-8289-7528fd79276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.872118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c6c16-1c56-4df5-8289-7528fd79276c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.872372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c6c16-1c56-4df5-8289-7528fd79276c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.872701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c6c16-1c56-4df5-8289-7528fd79276c None admin] PATH_INFO: `/v3/users/glance` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.881876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c6c16-1c56-4df5-8289-7528fd79276c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.883314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c6c16-1c56-4df5-8289-7528fd79276c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-346c6c16-1c56-4df5-8289-7528fd79276c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:45.894444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:45.895439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:45.896377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 250/506] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:45.896950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e873ef-87e7-4c6f-9d06-96b0b212d809 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.897072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e873ef-87e7-4c6f-9d06-96b0b212d809 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.897342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e873ef-87e7-4c6f-9d06-96b0b212d809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.914702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-01e873ef-87e7-4c6f-9d06-96b0b212d809 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:45.915921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-01e873ef-87e7-4c6f-9d06-96b0b212d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:45.969343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841c5a7-636b-4fe4-9c38-cfefdee21afd None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.982711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 251/507] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:45.983506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e873ef-87e7-4c6f-9d06-96b0b212d809 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.991221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.007455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.008186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.008466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.008744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.040906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.079740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.081463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.087963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e873ef-87e7-4c6f-9d06-96b0b212d809 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.120624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.121245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.121522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.121795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.122595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:46.122956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.124442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.160616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 252/508] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:46.161864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.178263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 257/509] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:46.179128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.228164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.238373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.265794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617f289-327a-411a-8655-9e5cf1dd6131 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.275916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53d686-2376-4632-9099-32fc1e47a23a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.300084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.300710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.300986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.301262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.302120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:46.302425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.303849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.310451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.311086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.311360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.311641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.312432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:46.312738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.314164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.314292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 253/510] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:46.315118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.332416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 258/511] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:46.333102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.419420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc893cb-be58-4487-b69b-10df7e2b1ab8 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.430159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a14c-ec4c-4d0e-8204-28f6645e3409 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.444268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.450456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.454545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.455190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.455469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.455775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.464853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.465466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.465744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.466017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.467227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.468741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:46.482951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:46.483851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:46.484719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:46.484719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:46.484719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:46.484719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:46.484719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 254/512] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:46.484975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.539941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.541437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.582113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7019-f762-4821-ad6e-22b340abe73c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.616024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.616664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.616940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.617212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.627687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.629134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.641950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 259/513] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:46.642782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:46.643286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:46.644156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:46.649849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:46.649849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:46.649849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:46.649849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:46.649849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 255/514] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:46.649849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.665917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.675822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.743259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739974a-748e-4915-ae45-4e9c377e482d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.745594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0efc0-c412-4aa3-afc5-5f61b7a50686 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.776653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.777301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.777580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.777852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.778430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.779051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.779334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.779609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.788135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.789620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:46.804258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:46.805178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:46.806102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:46.806102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:46.806102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:46.806102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:46.806102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 260/515] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:46.806378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.850958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.852572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.878644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.882143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:46.909185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228a34c-653a-47f1-bbb4-0b6a260746e7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:46.942486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:46.943036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:46.943314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:46.943589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:46.944298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:46.944600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:46.946040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:46.952871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 256/516] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:46.953710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:46.959476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 261/517] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:46.960343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.052149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e2be-355e-4d2f-b56a-626cf405f4b8 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.059030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd04c8-8c6f-4559-8551-7bd5bc8d309e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.081236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.087796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.088445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.088982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.088982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.089426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.094597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.095227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.095508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.095817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.096505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:47.096806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.098176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.099561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.101023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.111029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 262/518] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:47.111850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:47.116134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:47.116974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:47.117806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:47.117806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:47.117806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:47.117806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:47.117806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 257/519] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:47.118071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.210740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a4bbb-a456-4d54-8f86-6b3b6ad79dc0 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.215749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06d2a-d416-44bc-acaf-b6142a036fa2 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.242909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.243536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.243848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.244122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.244801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:47.245106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.246466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.248889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.249527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.249805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.250078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.257695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 263/520] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:47.258458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.260945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.262410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:47.277256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:47.278141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:47.278982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:47.278982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:47.278982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:47.278982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:47.278982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 258/521] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:47.279246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.310331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.320427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.361093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610ca7a-d82c-40a8-aff3-2139a7613214 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.392134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45670b7-e52c-45b1-adaf-8a5ba5132237 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.401135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.401766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.402393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.402682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.403366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.405189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.426894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.427076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 264/522] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:19:47 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:47.427537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.427723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.427841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.428118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.442743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.444951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:47.459729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:47.460964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:47.461878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 259/523] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:47.462484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.554458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3814ffa-4b03-4488-b2ae-ee8fb267d026 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.564641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.568605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.578044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039ceeb-1493-468a-9aa3-ffec2c066bc7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.598110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.598110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.598360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.598626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.599314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:47.599635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.601046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.613996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.614656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.614939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.615266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.615443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 265/524] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:47.616284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.623787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.625268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:47.637991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:47.638905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:47.639816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 260/525] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:47.640691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.720993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77054-1f38-45ee-9ccd-1e4324b4097e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.755233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738795-bd4c-47eb-b2f2-86345fe3eb7e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.759840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.760475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.760749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.761017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.761701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:47.762002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.763365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.778822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 266/526] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:47.778822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.798735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.799513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.799907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.800269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.801118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:47.801488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.802992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.804624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.826033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 261/527] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:47.827150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.843239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:47.879795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114ac9-5481-45f8-a848-e1cac39688d3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.914003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.915108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.915108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.915341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.922122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.923558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:47.935729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:47.936840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 267/528] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:47.943006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:47.953683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b89e-8418-45c3-b439-0b2129dac142 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:47.988989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:47.989516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:47.989791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:47.990057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:47.990837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:47.991140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:47.992647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:48.009421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 262/529] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:48.010281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:48.039482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:48.053212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960528d-eabc-441c-84bf-82fbe9fa1aea None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:48.088078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:48.088728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:48.089003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:48.089271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:48.091816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:48.097217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:48.098657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:48.110003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:48.110835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 268/530] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:48.112108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:48.127833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bcdcd-4a8f-4f93-9bff-ceaae616ef94 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:48.162086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:48.162711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:48.162985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:48.163257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:48.164074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=f1b5bd02365348098c1e7b448a996f12) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:48.164413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:48.165857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:48.171329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 263/531] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:48 2022] GET /identity/v3/role_assignments?user.id=f1b5bd02365348098c1e7b448a996f12&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:48.180047 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:48.238509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd762d-e52c-459a-bd88-99c15d1160cf None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:48.298508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:48.299223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:48.299711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:48.300081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:48.300947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:48.306076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:48.307807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:48.343445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 269/532] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:48.346344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:48.366473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:48.368562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80a147-6e00-4310-ad92-8e04cecc3b3c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:48.435031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:48.435850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:48.436254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:48.436622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:48.452490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:48.504056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817fdc5-aa0f-4df0-9619-c77e815b6e04 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:48.560139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:48.560695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:48.560969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:48.561239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:48.561992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:48.562293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:48.565320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:48.565451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:48.566686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:48.584217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 270/533] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:48.585451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:48.664066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:48.729813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea72ad-55ff-4faa-b883-15a6e4f51760 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:48.789926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 264/534] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:48.790729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:48.790854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:48.791732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:48.792208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:48.792676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:48.793949 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=0c08bdb04cc146fa8f6c6bb626c30437) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:48.795375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:48.797048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:48.805100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 271/535] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:48 2022] GET /identity/v3/role_assignments?user.id=0c08bdb04cc146fa8f6c6bb626c30437&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:48.806430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:48.852638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:48.973633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1637e-72bc-431b-a637-e79a158da95c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:49.008191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1848ea6-7007-4b99-a6cc-2733d15ff811 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:49.037859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:49.038859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:49.039389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:49.039899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:49.040978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=d1e0e81d0ee04020b43c28347ef3ab6c) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:49.041501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:49.043184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:49.048660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:49.052190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 265/536] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:48 2022] GET /identity/v3/role_assignments?user.id=d1e0e81d0ee04020b43c28347ef3ab6c&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:49.061250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:49.061937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:49.062210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:49.062487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:49.079432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:49.080986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:49.105464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:49.107046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:49.108311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:49.108311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:49.108311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:49.108311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:49.108311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 272/537] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:49.112667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:49.277049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:49.283924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd99a8-1214-4b6c-b51c-1a8f2b03895a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:49.328534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:49.329172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:49.329456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:49.329734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:49.330437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:49.330742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:49.332184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:49.347090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 266/538] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:49.352881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:49.470539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dc24a-c453-4d32-9139-cb6aae1fbd6d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:49.505047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cf2ce-4cbb-4ff3-9391-70fc830bac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:49.505842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cf2ce-4cbb-4ff3-9391-70fc830bac15 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:49.506122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cf2ce-4cbb-4ff3-9391-70fc830bac15 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:49.506378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cf2ce-4cbb-4ff3-9391-70fc830bac15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:49.513289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cf2ce-4cbb-4ff3-9391-70fc830bac15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:49.514751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cf2ce-4cbb-4ff3-9391-70fc830bac15 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-3f8cf2ce-4cbb-4ff3-9391-70fc830bac15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:49.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:49.527428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:49.528334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 273/539] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:49.534998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:49.571733 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04397c6e-cedf-481c-951e-8fa14b9a86c6 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:49.572404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04397c6e-cedf-481c-951e-8fa14b9a86c6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:49.572647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04397c6e-cedf-481c-951e-8fa14b9a86c6 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:49.574379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 274/540] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:49.584565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ccac-2599-41f8-8518-94d8aef7338b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:49.584844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ccac-2599-41f8-8518-94d8aef7338b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:49.585113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ccac-2599-41f8-8518-94d8aef7338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:49.610413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-8fe2ccac-2599-41f8-8518-94d8aef7338b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:49.611631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8fe2ccac-2599-41f8-8518-94d8aef7338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:49.720005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:49.731791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 275/541] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:49.738944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90348d-8ced-441a-8eaf-dcb2bff1e2fa None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:49.770040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ccac-2599-41f8-8518-94d8aef7338b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:49.798615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:49.799247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:49.799522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:49.799814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:49.800585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:49.800915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:49.802376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:49.830111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 267/542] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:49.836184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:49.861404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:49.964474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e01994-81ad-4e16-bd32-75469e280466 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:49.965542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ccac-2599-41f8-8518-94d8aef7338b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:50.033468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.034872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.035147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.035417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.039650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=c206251915e74dba98b9422cf2f026d2) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:50.039650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:50.039650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:50.043890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.043890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.043890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.043890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.058312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 268/543] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:49 2022] GET /identity/v3/role_assignments?user.id=c206251915e74dba98b9422cf2f026d2&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:50.059200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:50.068296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:50.069234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:50.070023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 276/544] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:50.082416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:50.221058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:50.240366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e951d8f-d264-4c61-b5c1-37b5075d74bc None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:50.291053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d1818-9118-47e3-a7b4-ca451e63cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.291607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d1818-9118-47e3-a7b4-ca451e63cabb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.291913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d1818-9118-47e3-a7b4-ca451e63cabb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.292184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d1818-9118-47e3-a7b4-ca451e63cabb None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.292917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d1818-9118-47e3-a7b4-ca451e63cabb None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:50.293216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d1818-9118-47e3-a7b4-ca451e63cabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:50.294623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d1818-9118-47e3-a7b4-ca451e63cabb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:50.304724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 269/545] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:50.310593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:50.320258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8df2-c555-4ce7-b685-1276ae158e67 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.320904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8df2-c555-4ce7-b685-1276ae158e67 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.321350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8df2-c555-4ce7-b685-1276ae158e67 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.323631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 270/546] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:19:50.328906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03946-1960-46c2-b9da-00cb1e90d8d3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.329862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03946-1960-46c2-b9da-00cb1e90d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.330359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03946-1960-46c2-b9da-00cb1e90d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.358285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1ad03946-1960-46c2-b9da-00cb1e90d8d3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:50.360260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1ad03946-1960-46c2-b9da-00cb1e90d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:50.378161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:50.485891 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 271/547] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:50.500982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2987-54ee-4a54-a2dc-4ae783a609f4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:50.520053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad03946-1960-46c2-b9da-00cb1e90d8d3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:50.558513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.559195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.559478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.559869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.577381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:50.579001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:50.606417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:50.607309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:50.608187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:50.608187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:50.608187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:50.608187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:50.615871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 277/548] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:50.618555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:50.621816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:50.658954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad03946-1960-46c2-b9da-00cb1e90d8d3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:50.707105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.708079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.708521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.708935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.726938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:50.744330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:50.745544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:50.747160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:50.749904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 272/549] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:50.755853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:50.774880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:50.803742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44419ce-5c23-46e9-b87d-9175a5e57747 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:50.873363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.873555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084c5ac-0ae0-437b-80a2-065c3191d3a7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:50.873918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.874196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.874466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.875157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:50.875456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:50.876853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:50.897829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 278/550] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:50.904606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:50.915750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.920040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.920331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.921028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.921774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:50.922079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:50.923851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:50.928718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:50.942887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 273/551] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:50.949683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:51.073303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331031be-916a-4503-9131-7fb7368a9c67 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.112373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:51.113035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.113443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.113730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.122377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:51.123931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:51.138995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:51.139976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:51.141016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 279/552] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:51.146499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:51.165661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:51.205782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5289f-06db-4072-8ca9-27c754ce66f9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.272873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124ee3d-09ae-4f14-8dda-c813836abd59 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.300351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:51.301012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.301294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.301575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.316119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50aa03-8862-4be4-84c6-7a3e22b5497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:51.316753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50aa03-8862-4be4-84c6-7a3e22b5497e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.317074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50aa03-8862-4be4-84c6-7a3e22b5497e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.317494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50aa03-8862-4be4-84c6-7a3e22b5497e None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.318295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50aa03-8862-4be4-84c6-7a3e22b5497e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:51.319958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50aa03-8862-4be4-84c6-7a3e22b5497e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:51.321454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50aa03-8862-4be4-84c6-7a3e22b5497e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:51.325664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:51.327180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:51.358294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:51.360337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:51.362434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:51.362434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:51.362434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:51.362434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:51.362908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 280/553] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Jul 28 06:19:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:51.363046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 274/554] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:51.363177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce600-0c6c-436b-b3fc-f6bb9d6e3791 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.363177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce600-0c6c-436b-b3fc-f6bb9d6e3791 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.363177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce600-0c6c-436b-b3fc-f6bb9d6e3791 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.367649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:51.367868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 281/555] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:51.367868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce600-0c6c-436b-b3fc-f6bb9d6e3791 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:51.422668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:51.469720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:51.486311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2fa0-e301-4a47-b72a-0534def94189 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.520819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce600-0c6c-436b-b3fc-f6bb9d6e3791 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.526507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1bc32-1f2c-4c75-bd25-267b524ec7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:51.527140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1bc32-1f2c-4c75-bd25-267b524ec7b6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.527422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1bc32-1f2c-4c75-bd25-267b524ec7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.527729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1bc32-1f2c-4c75-bd25-267b524ec7b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.556815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb20b5-7dc3-49cd-85fb-a59e8e7238c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:51.557836 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb20b5-7dc3-49cd-85fb-a59e8e7238c9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.558129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb20b5-7dc3-49cd-85fb-a59e8e7238c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.558662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb20b5-7dc3-49cd-85fb-a59e8e7238c9 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.559587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb20b5-7dc3-49cd-85fb-a59e8e7238c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:51.559928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb20b5-7dc3-49cd-85fb-a59e8e7238c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:51.562003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb20b5-7dc3-49cd-85fb-a59e8e7238c9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:51.576286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 282/556] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:51.577480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c3f80-e647-4555-bf67-ca58df51ed47 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.577767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c3f80-e647-4555-bf67-ca58df51ed47 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.578038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c3f80-e647-4555-bf67-ca58df51ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.597843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-cf5c3f80-e647-4555-bf67-ca58df51ed47 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:51.599057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-cf5c3f80-e647-4555-bf67-ca58df51ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:51.603692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1bc32-1f2c-4c75-bd25-267b524ec7b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:51.605153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1bc32-1f2c-4c75-bd25-267b524ec7b6 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:51.660690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:51.679747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 283/557] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:51.679747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b4bb-57e6-4fd6-bf03-6e312dd569a2 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.679747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b4bb-57e6-4fd6-bf03-6e312dd569a2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.679747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b4bb-57e6-4fd6-bf03-6e312dd569a2 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.679747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 284/558] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:51.679747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130b4bb-57e6-4fd6-bf03-6e312dd569a2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:51.727679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 275/559] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:51.729196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399243ed-0732-488c-a45b-f0aeaadb84ab None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.729660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399243ed-0732-488c-a45b-f0aeaadb84ab None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.730077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399243ed-0732-488c-a45b-f0aeaadb84ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.749208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-399243ed-0732-488c-a45b-f0aeaadb84ab None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:51.749391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:51.750912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-399243ed-0732-488c-a45b-f0aeaadb84ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:51.796336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130b4bb-57e6-4fd6-bf03-6e312dd569a2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.821802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 276/560] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:51.823294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399243ed-0732-488c-a45b-f0aeaadb84ab None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:51.842648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:51.843650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.844132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.844620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] PATH_INFO: `/v3/users/nova` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.852818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:51.854365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:51.866479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:51.867536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 285/561] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:19:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:51.873130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:51.925043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:51.946154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399243ed-0732-488c-a45b-f0aeaadb84ab None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.976049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14ba7-277c-4c05-85d1-7a0e3f94f24b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:51.982707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:51.983457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:51.983762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:51.984035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:51.989989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:51.997120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:52.002495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:52.003427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:52.004292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 277/562] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:52.004997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.017754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.018386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.018698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.018946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.039381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.041300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:52.064103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:52.065263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:52.066445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:52.066445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:52.066445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.066445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:52.068007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 286/563] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:52.068950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.120390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27146-ef37-4c04-a755-384e73f4c117 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.155559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.156248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.156532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.156813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.164955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.168390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:52.173712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:52.174639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:52.175980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 278/564] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:52.176799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.188063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373703-244b-4e6e-a788-be17d0d29c29 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.225769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.226414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.226731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.227006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.228060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:52.228190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.229557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.252323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 287/565] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:52.252323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.277487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.292247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84561c-af66-44f7-b281-9d830e0eb0dc None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.333655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.334672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.334672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.334944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.335674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:52.336019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.337409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.346852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 279/566] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:52.347755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.362750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08dcb-b6d5-4460-bf3e-aeafd13a0eaa None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.397272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.398023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.398300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.398556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.399231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:52.399518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.400934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.410737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.412192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 288/567] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:52.413098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.454678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffba58-63f4-4527-a517-26e6cf893b0b None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.488329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b324b5-d5c5-4a7c-8ab9-2c828526d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.488874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b324b5-d5c5-4a7c-8ab9-2c828526d4fa None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.489156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b324b5-d5c5-4a7c-8ab9-2c828526d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.489432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b324b5-d5c5-4a7c-8ab9-2c828526d4fa None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.490181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b324b5-d5c5-4a7c-8ab9-2c828526d4fa None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:52.490485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b324b5-d5c5-4a7c-8ab9-2c828526d4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.491879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b324b5-d5c5-4a7c-8ab9-2c828526d4fa None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.497113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.500356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 280/568] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:52.501723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8327f-08dc-42e1-b39c-cc2dc6b45d81 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.502160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8327f-08dc-42e1-b39c-cc2dc6b45d81 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.502583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8327f-08dc-42e1-b39c-cc2dc6b45d81 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.507888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 281/569] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:52.508574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8327f-08dc-42e1-b39c-cc2dc6b45d81 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.514551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b63b-7ceb-4920-9d7f-b94acc3892b6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.549860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.550504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.550771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.551053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.561849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.563299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:52.577922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:52.578812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:52.579727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:52.579727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:52.579727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.579727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:52.579727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 289/570] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:52.580413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.609781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8327f-08dc-42e1-b39c-cc2dc6b45d81 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.637007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.649862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.650518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.650799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.651076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.661873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.663320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:52.677284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:52.678172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:52.679051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:52.679051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:52.679051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.679051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:52.679051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 282/571] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:52.679517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.691340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2bb2-dfb0-4b0b-b5bd-1cf40c323a63 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.725219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36b0a-d926-4187-940d-77eb7d6658f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.725855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36b0a-d926-4187-940d-77eb7d6658f3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.726139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36b0a-d926-4187-940d-77eb7d6658f3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.726524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36b0a-d926-4187-940d-77eb7d6658f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.729235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.733891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed36b0a-d926-4187-940d-77eb7d6658f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.735659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed36b0a-d926-4187-940d-77eb7d6658f3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-2ed36b0a-d926-4187-940d-77eb7d6658f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:52.747855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:52.749017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 290/572] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:52.750120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaa099-993c-4d53-9364-c97313b0bf55 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.750699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaa099-993c-4d53-9364-c97313b0bf55 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.750699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaa099-993c-4d53-9364-c97313b0bf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.769118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-8aeaa099-993c-4d53-9364-c97313b0bf55 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:52.770329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8aeaa099-993c-4d53-9364-c97313b0bf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:52.790389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f58c19-2da4-4e98-898d-4224e87d5dc3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.824043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.824693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.824976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.825248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.835586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 291/573] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:52.835715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.836553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaa099-993c-4d53-9364-c97313b0bf55 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.837247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:52.865718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:52.866831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:52.867941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:52.867941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:52.867941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:52.867941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:52.867941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 283/574] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:52.867941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.894766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.937943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaa099-993c-4d53-9364-c97313b0bf55 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.963775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.970848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c73f-9b85-471e-bdc4-828b9ca2ca9d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.972667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.973301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.973571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.973861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.974538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:52.974840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.976244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.987578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 292/575] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:52.988242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.003501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.004087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.004368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.004669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.005363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.005665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.007036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.018737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 284/576] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:53.019562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.099117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efca35-3f3d-4f24-a527-4b88715623e4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.110595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.122887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546d042-6fa7-4eb2-b87e-6d3da459502e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.133119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.133734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.134033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.134282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.135028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.135330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.136779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.148657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 293/577] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:53.153977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.157826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.158515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.158793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.159069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.169376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:53.174247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:53.175182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:53.176075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 285/578] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:53.176770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.203017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.255101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddeee1e-b3d1-4984-9670-e952d07acc7b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.274164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef19a3-0e30-48af-be7d-e2a0d87d239c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.290431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.291052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.291430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.291738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.292424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.292726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.294117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.305984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 294/579] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:53.306785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.307903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.308554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.308818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.309157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.317385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.319149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:53.330632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:53.331521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:53.332442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 286/580] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:53.332931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.343052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.420323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbd166-b755-4d0d-b3a3-74b7015dfe72 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.427119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.428417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49208cf4-7093-4570-baf6-2fecac9e9fc0 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.454760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.455426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.455730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.456011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.463554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.463932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.464553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.464834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.465044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.465132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.465887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=969f6ef78a6342e49325ea63f50b69ea) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.466193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.467644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.473148 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 287/581] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/role_assignments?user.id=969f6ef78a6342e49325ea63f50b69ea&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:53.473837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:53.476201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:53.477391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 295/582] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:53.483383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.562122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.597196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f06030-777e-4257-9b90-230a2aae4be6 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.597725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed1e07-63e1-4a8d-93f7-0e3938597cf2 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.632245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.633810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.633810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.633810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.641501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.641665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.642145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.642425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.642698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.643122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.643426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.643878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.645389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:53.654732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:53.655751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 06:19:53.656717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:53.658855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 288/583] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:53.659541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.660070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 296/584] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:53.661141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.691698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.772509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a500-cbf5-4c73-b4f7-b3b5b2ea8cb7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.772880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb15fb8-ba33-4e2f-a59d-4ce52d94b31b None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.806718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.806935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.807575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.807692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.807907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.808132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.808222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.808567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.808921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.809232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.809639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.810037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.810723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.811661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.812421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.825484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 289/585] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:53.826441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.834132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 297/586] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:53.835151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.922531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.934362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33a533-4700-4bd5-823a-ca6fadb5c42a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.940500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202be0f-666e-4ee5-82d7-290758d3d2d6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.969659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.970309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.970589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.970893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.977260 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.978054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.978407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.978753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.979751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:53.980127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.981383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.981694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.982959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:53.997995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:53.999113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:54.000268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:54.000268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:54.000268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:54.000268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:54.009644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 290/587] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:54.009789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 298/588] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:54.009885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.009972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.060695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:54.119909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11699-3be3-4198-aac4-ac5609b92bd5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.123010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b41b40-0820-40d5-b7a1-b84ca36c5430 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.155959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.156633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.156918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.157184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/f1b5bd02365348098c1e7b448a996f12/roles/2ceab442c0cc49b5ad07767f77f687fe` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.159295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.159984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.160259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.160543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.171666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.172810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=f1b5bd02365348098c1e7b448a996f12, role_id=2ceab442c0cc49b5ad07767f77f687fe)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.173134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.174449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.175078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:54.190077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:54.191000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:54.192037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:54.192037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:54.192037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:54.192037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:54.192257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 291/589] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:54 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/f1b5bd02365348098c1e7b448a996f12/roles/2ceab442c0cc49b5ad07767f77f687fe => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:54.192257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.200729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 299/590] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:54.202673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.315227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:54.324305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066192b1-b6e8-4e55-8e4d-df9b71c43246 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.333603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813744f-c9a6-4b0c-8198-81ea68283d43 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.365404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.366812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.367274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.367826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.372818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.373388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.373669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.373944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.374696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:54.375003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.376627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.380780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.382268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.390938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 300/591] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:54.392034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:54.400227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:54.401157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:54.402037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:54.402037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:54.402037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:54.402037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:54.402037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 292/592] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:54.402548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.456550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:54.519915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7519-94b6-47c0-b727-5e39c635c3b5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.520118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fe1ec-8c84-45e6-ba30-25f4b951f657 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.556866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.557542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.557815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.558089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.565248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.566029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.566443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.566714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.566938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.567403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:54.567733 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.568439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.569086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:54.581117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:54.582084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:54.583022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 293/593] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:54.583610 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 301/594] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:54.583711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.592529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.597330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:54.693198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d24a7b-2c68-4350-9054-af8c8f633af4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.696422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46f3ec-b879-4ad1-b99f-922ecfb078cd None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.712600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:54.734008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.734669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.734945 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.735223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.742363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.744205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.745777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.747135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.747435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.747829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.748591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:54.748900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.750366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:54.756550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:54.757451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:54.758377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 302/595] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:54.758886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.771510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 294/596] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:54.776465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.867820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:54.868623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a521a-3187-407b-86d5-a5e98aa39660 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.907868 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb3825-fa2e-4dae-91a4-dc66ecdc0c77 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.912352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.913191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.913618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.914070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.915008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:54.915931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.917380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.947897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 303/597] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:54.948942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.949331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.949565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.949843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.950115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.950911 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:54.951160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.952737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.973250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 295/598] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:54.975033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.988067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.058224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c8f4b-a60d-4535-9581-3648a74f6341 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.087866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8d058-a226-45ce-810e-ab90eca11f22 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.094167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.094818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.095102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.095360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.102652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.104155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:55.115443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:55.116472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:55.117413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 304/599] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:55.117898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.122197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.132051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.133007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.133543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.133962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.146312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.148139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:55.164319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:55.165431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:55.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:55.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:55.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:55.166555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:55.173947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 296/600] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:55.174938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.211064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.219503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff61e05-9735-4809-803b-7bc3c2de78d2 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.254432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.254646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.254865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.255189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/0c08bdb04cc146fa8f6c6bb626c30437/roles/2ceab442c0cc49b5ad07767f77f687fe` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.270218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=0c08bdb04cc146fa8f6c6bb626c30437, role_id=2ceab442c0cc49b5ad07767f77f687fe)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.271689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.290063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939463-da6d-47be-9a31-df7c6bc73ed0 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.303960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 305/601] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:55 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/0c08bdb04cc146fa8f6c6bb626c30437/roles/2ceab442c0cc49b5ad07767f77f687fe => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:55.303960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.364467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.365520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.366457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.366880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.367949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:55.368442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.370420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.395001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 297/602] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:55.400756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.400990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ed2b3-9797-4363-8a6b-dd81316f5adb None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.453532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64654e9d-4f96-4193-a558-4422488496e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.454184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64654e9d-4f96-4193-a558-4422488496e1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.454461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64654e9d-4f96-4193-a558-4422488496e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.454741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64654e9d-4f96-4193-a558-4422488496e1 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.455451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64654e9d-4f96-4193-a558-4422488496e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:55.456688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64654e9d-4f96-4193-a558-4422488496e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.458111 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64654e9d-4f96-4193-a558-4422488496e1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.477152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 306/603] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:55.479133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.480134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9fd76-2d2d-4f56-bd27-5ef025d462e2 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.480751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9fd76-2d2d-4f56-bd27-5ef025d462e2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.481581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9fd76-2d2d-4f56-bd27-5ef025d462e2 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.488030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 307/604] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:55.489066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9fd76-2d2d-4f56-bd27-5ef025d462e2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.492312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.558154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9dff3-4c67-436a-a915-cda557587037 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.600976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce052f0-48e9-4a5a-bb78-bfd2437bf033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.600976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce052f0-48e9-4a5a-bb78-bfd2437bf033 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.601424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce052f0-48e9-4a5a-bb78-bfd2437bf033 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.601587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce052f0-48e9-4a5a-bb78-bfd2437bf033 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/d1e0e81d0ee04020b43c28347ef3ab6c/roles/2ceab442c0cc49b5ad07767f77f687fe` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.618486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce052f0-48e9-4a5a-bb78-bfd2437bf033 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=d1e0e81d0ee04020b43c28347ef3ab6c, role_id=2ceab442c0cc49b5ad07767f77f687fe)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.619969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce052f0-48e9-4a5a-bb78-bfd2437bf033 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.626280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9fd76-2d2d-4f56-bd27-5ef025d462e2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.637825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 298/605] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:55 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/d1e0e81d0ee04020b43c28347ef3ab6c/roles/2ceab442c0cc49b5ad07767f77f687fe => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:55.639535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d507-f3d9-4835-8d3b-6a713edaec25 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.640103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d507-f3d9-4835-8d3b-6a713edaec25 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.640557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d507-f3d9-4835-8d3b-6a713edaec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.660274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1868d507-f3d9-4835-8d3b-6a713edaec25 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:55.662026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1868d507-f3d9-4835-8d3b-6a713edaec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:55.668016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.669118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.669589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.670052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.680670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.682771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:55.699802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:55.700758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:55.701641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:55.704807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 308/606] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:55.716793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.749930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 299/607] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:55.791808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d507-f3d9-4835-8d3b-6a713edaec25 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.799063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.844347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.887885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf66722-426c-486c-b16d-18e01866cc8b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.927498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.928177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.928458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.928737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.929535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:55.929921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.931365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.949883 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 309/608] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:55.954150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.955643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d507-f3d9-4835-8d3b-6a713edaec25 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.995859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.996527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.996804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.997072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.008797 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:56.013710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:56.014632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:56.015554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 300/609] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:56.020873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.059130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996aa7f-f165-4451-b6ba-65c8f8788974 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.094751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:56.097197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.097888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.098220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.098506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/c206251915e74dba98b9422cf2f026d2/roles/2ceab442c0cc49b5ad07767f77f687fe` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.106648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:56.116297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=c206251915e74dba98b9422cf2f026d2, role_id=2ceab442c0cc49b5ad07767f77f687fe)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.118542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.128598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492a95a-d207-411f-9e64-505f3d493687 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.140569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 310/610] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:55 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/c206251915e74dba98b9422cf2f026d2/roles/2ceab442c0cc49b5ad07767f77f687fe => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:56.181831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.182479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.182756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.183025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.183857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:56.184156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.185624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.199371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 301/611] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:56.205204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.341895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2614c6-f3ba-4993-a83a-6ac2ecc33fd3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.378149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a830c6-9dd9-44d6-aebd-67cb79ccbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.378802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a830c6-9dd9-44d6-aebd-67cb79ccbf2f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.379080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a830c6-9dd9-44d6-aebd-67cb79ccbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.379431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a830c6-9dd9-44d6-aebd-67cb79ccbf2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.393686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a830c6-9dd9-44d6-aebd-67cb79ccbf2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.395215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a830c6-9dd9-44d6-aebd-67cb79ccbf2f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-a3a830c6-9dd9-44d6-aebd-67cb79ccbf2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:56.411011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:56.412007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:56.413337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:56.413337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:56.413337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:56.413337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:56.413337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 311/612] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:56.418327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.422612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7be2a-4466-4929-9efe-79870dd77213 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.422890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7be2a-4466-4929-9efe-79870dd77213 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.423159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7be2a-4466-4929-9efe-79870dd77213 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.424755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 312/613] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:56.435463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59a8c8-aec4-4806-aa9d-c2573aa55785 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.435780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59a8c8-aec4-4806-aa9d-c2573aa55785 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.436057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59a8c8-aec4-4806-aa9d-c2573aa55785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.470215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ad59a8c8-aec4-4806-aa9d-c2573aa55785 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:56.471412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ad59a8c8-aec4-4806-aa9d-c2573aa55785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:56.506654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:56.583070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf37d9-37ef-4456-916f-5a8c327fb71a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.597659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 313/614] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 06:19:56.639209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59a8c8-aec4-4806-aa9d-c2573aa55785 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.653734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.654365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.654641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.654906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.655603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:56.655930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.657306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.682417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 302/615] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:56.686109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.691936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:56.805047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59a8c8-aec4-4806-aa9d-c2573aa55785 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.861575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d30bc-022f-4f4a-b0b2-7c9c5c33d024 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.879139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.880183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.880669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.881161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.902502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:56.908967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:56.909890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:56.910720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:56.915575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 314/616] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:19:56.920803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.942814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.943812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.944317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.944792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] PATH_INFO: `/v3/users/swift` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.955271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:56.962024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.963818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:56.991395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:56.992507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:19:56.993440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:57.001901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 303/617] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:57.007722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.103741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539274f3-77ad-48f9-aa73-74e9c195d740 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.148069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:57.166270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.166911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.167190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.167462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.168222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:57.168525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.169918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.191735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 315/618] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:57.196623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.223416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49a01e-1ed5-4272-85a9-253681e38fdb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.290893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.291516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.291818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.292093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.292887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:57.293188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.294624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.332086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 304/619] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:57.337718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.346500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:57.380912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca1d4f-1a13-4f05-9121-2bd1d65aa573 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.454450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.455483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.455990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.456460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.479808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.481269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.495955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b4ec-b8a2-4e01-b66d-45a160aa3b7a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:57.506660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:57.507601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:57.508567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:57.508567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:57.508567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:57.508567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:57.513210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 316/620] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:57.515819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.535990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:57.564162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.564914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.565196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.565464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.587082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.588587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:57.613169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:57.614124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:57.615018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:57.615018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:57.615018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:57.615018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:57.615018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 305/621] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:57.619791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.650782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666df45-770a-4029-8f30-af5a3e939fa6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.678182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:57.687521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.688178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.688454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.688722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.689513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:57.689817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.691183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.708930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 317/622] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:57.710208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.790618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd420e-a648-40d2-bfc1-c88585ee316b None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.815149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228827-b7bb-4399-b806-d9f21adc8f33 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.850666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.851344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.851641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.851926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.863308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.864819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.870193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.870827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.871103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.871401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.872126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:57.872427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.873784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:19:57.893555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:57.894563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:19:57.895520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:57.902560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 318/623] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:57.903013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 306/624] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:57.904386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.908865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.984082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.001975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.095813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c73ba-54c9-4d83-b42f-e57cde9cdce4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.104945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2882cd-3ae2-4d39-ae39-c41073e4dd20 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.130461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08347141-4d9e-44f1-bc01-cf15db26597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.131187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347141-4d9e-44f1-bc01-cf15db26597b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.131466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347141-4d9e-44f1-bc01-cf15db26597b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.131769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347141-4d9e-44f1-bc01-cf15db26597b None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.132569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08347141-4d9e-44f1-bc01-cf15db26597b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:58.132962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08347141-4d9e-44f1-bc01-cf15db26597b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.134599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08347141-4d9e-44f1-bc01-cf15db26597b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.141389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256498e-fd95-4b2a-a4ee-4b69bed43ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.142043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256498e-fd95-4b2a-a4ee-4b69bed43ba2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.142325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256498e-fd95-4b2a-a4ee-4b69bed43ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.142598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256498e-fd95-4b2a-a4ee-4b69bed43ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.149546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256498e-fd95-4b2a-a4ee-4b69bed43ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.152135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256498e-fd95-4b2a-a4ee-4b69bed43ba2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.153748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 319/625] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:19:58.154993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b757-3922-4ae8-8ab6-fe6ee0795ecc None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.155275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b757-3922-4ae8-8ab6-fe6ee0795ecc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.155546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b757-3922-4ae8-8ab6-fe6ee0795ecc None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.157175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 320/626] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:58.160731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb445-71b7-41bd-bda1-7eb6f39459a1 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.161235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb445-71b7-41bd-bda1-7eb6f39459a1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.161516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb445-71b7-41bd-bda1-7eb6f39459a1 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.162891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 321/627] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:58.164508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb445-71b7-41bd-bda1-7eb6f39459a1 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-d256498e-fd95-4b2a-a4ee-4b69bed43ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:58.170426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:58.171357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:58.172301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 307/628] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:58.173245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af7267-0193-4115-84d8-671e2482b23e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.173526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af7267-0193-4115-84d8-671e2482b23e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.173799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af7267-0193-4115-84d8-671e2482b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.191850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-70af7267-0193-4115-84d8-671e2482b23e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:58.193028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-70af7267-0193-4115-84d8-671e2482b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:58.266323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 308/629] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:58.267899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e789ce-cfb8-424a-9caf-bcfb5da2cf6e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.268185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e789ce-cfb8-424a-9caf-bcfb5da2cf6e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.268456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e789ce-cfb8-424a-9caf-bcfb5da2cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.287036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-78e789ce-cfb8-424a-9caf-bcfb5da2cf6e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:58.287976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb445-71b7-41bd-bda1-7eb6f39459a1 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.288248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-78e789ce-cfb8-424a-9caf-bcfb5da2cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:58.297754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.306646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.327893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.328524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.328803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.329077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.357025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 309/630] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:58.357858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e789ce-cfb8-424a-9caf-bcfb5da2cf6e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.396213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.397643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.468752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e789ce-cfb8-424a-9caf-bcfb5da2cf6e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.503191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9a9b-27c9-4efb-8452-787b4d9bdc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.503915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9a9b-27c9-4efb-8452-787b4d9bdc3b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.504121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9a9b-27c9-4efb-8452-787b4d9bdc3b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.504317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 322/631] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:19:58.504672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9a9b-27c9-4efb-8452-787b4d9bdc3b None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.505209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9a9b-27c9-4efb-8452-787b4d9bdc3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:58.505314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.505449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9a9b-27c9-4efb-8452-787b4d9bdc3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.506896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9a9b-27c9-4efb-8452-787b4d9bdc3b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.517065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.525214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 310/632] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:58.525214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1340f53-59d2-42c4-8fdb-6ef1793e9172 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.525214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1340f53-59d2-42c4-8fdb-6ef1793e9172 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.525214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1340f53-59d2-42c4-8fdb-6ef1793e9172 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.525214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 311/633] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:19:58.525214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1340f53-59d2-42c4-8fdb-6ef1793e9172 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.539950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.616293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4570-90e5-4338-a34c-2aa5341bf206 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.628804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1340f53-59d2-42c4-8fdb-6ef1793e9172 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.651072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.651746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.652027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.652302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.661213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b0847-5645-4a59-a4a7-fcd843d67c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.661849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0847-5645-4a59-a4a7-fcd843d67c0b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.662127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0847-5645-4a59-a4a7-fcd843d67c0b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.662398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0847-5645-4a59-a4a7-fcd843d67c0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.662790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:58.667781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:58.668707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:58.669532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:58.672317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b0847-5645-4a59-a4a7-fcd843d67c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:58.673986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 323/634] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:58.674819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-201b0847-5645-4a59-a4a7-fcd843d67c0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:58.677535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:58.678465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:58.679308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 312/635] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:58.680175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341047d6-985e-4902-980d-99cbcafe85bc None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.680556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341047d6-985e-4902-980d-99cbcafe85bc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.680728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341047d6-985e-4902-980d-99cbcafe85bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.698003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-341047d6-985e-4902-980d-99cbcafe85bc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:58.699185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-341047d6-985e-4902-980d-99cbcafe85bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:58.742422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.765057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 313/636] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:19:58.765865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341047d6-985e-4902-980d-99cbcafe85bc None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.768176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.777634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b097-b529-42a8-bea8-d5cc8e9368b3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.812177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.812825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.813106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.813380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.823520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.824982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:58.839826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:58.840758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:58.841649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:58.841649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:58.841649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:58.841649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:58.841649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 324/637] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:58.841930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.866918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341047d6-985e-4902-980d-99cbcafe85bc None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.900292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.900965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.901248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.901545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/969f6ef78a6342e49325ea63f50b69ea/roles/2ceab442c0cc49b5ad07767f77f687fe` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.916413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=969f6ef78a6342e49325ea63f50b69ea, role_id=2ceab442c0cc49b5ad07767f77f687fe)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.917904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.931878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 314/638] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:19:58 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/969f6ef78a6342e49325ea63f50b69ea/roles/2ceab442c0cc49b5ad07767f77f687fe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:58.932495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.953212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d182637-d79c-4869-9a9e-5f2899b59c61 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.975659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.992488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:58.998719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.999383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.999710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.999990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.000777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:59.001026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.002435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.011795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 325/639] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:59.012474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.053942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081c71-9730-4635-98f3-bebf5e2cb209 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.097595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.098212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.098495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.098775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.099515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:59.099851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.101268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.109748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 315/640] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:59.110698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.134284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d5cd-1a05-4837-b3b5-fc43e537f34c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.167571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.168259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.168541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.168816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.178927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:19:59.184365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:59.185508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 326/641] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:59.186348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.226511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d1315-c6de-43d0-bd83-563d5f59c77e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.235818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.240443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.261517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.262144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.262424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.262697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.263377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:59.263713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.265097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.277715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 316/642] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:59.278559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.306296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9360a-dca2-441a-b5ab-98722b2dff49 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.341971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.342937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.343393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.343875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.355104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.357001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:59.372348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:59.373336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:59.374227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:59.374227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:59.374227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:59.374227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:59.374227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 327/643] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:59.374528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.386148 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a468f-62d1-4ab3-8547-61312d997f9a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.427651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.428576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.428860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.429406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.442982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.444784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:59.465286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:59.466250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:59.467225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:59.467225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:59.467225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:59.467225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:59.470905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 317/644] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:59.472102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.475138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.485298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57352c63-2de0-4d7b-b10d-489ec2383661 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.501473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.522825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.523501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.523985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.524275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.525291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:59.525601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.526997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.542270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 328/645] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:59.542270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.575720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8281c-683e-4bbf-8cb7-0852e24f13bd None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.612775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.613318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.613731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.613997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.621971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.623437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:19:59.635328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:59.636289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:19:59.637178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 318/646] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:59.638291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.662935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f32215-f975-4b42-9b25-b5c84bbe480a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.700307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.701290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.701747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.702209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.702964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:59.703267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.704661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.721778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 329/647] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:59.721778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.724830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.736975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.740524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2b1cf-786d-4db3-9597-aa71676ef47f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.774136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.774759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.775044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.775320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.776044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:59.776343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.777730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.789288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 319/648] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:59.790068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.832155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddde7b-aa4c-4de5-ac4e-41b3eb1f2a5b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.867599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.868487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.868925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.869332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.879923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.881594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.888761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126707-625c-42f1-929c-2c065546bc01 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:19:59.896954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:19:59.897968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:19:59.899079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:19:59.899079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:19:59.899079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:19:59.899079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:19:59.900674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 330/649] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:19:59.901597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.928517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.929141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.929527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.929788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.930541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:59.930828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.932369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.944481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 320/650] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:59.945438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.957323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.975199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.011045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c47f-04b1-4eaa-adc2-ffc5ba102227 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.053817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.054526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.054813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.055091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] PATH_INFO: `/v3/users/glance` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.063048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.063714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8554e5-7d31-4b1e-8b9a-50f66073dbb4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.064560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:00.077015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:00.077977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:00.078895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 331/651] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:00.079505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.105948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.106537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.106823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.107108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.114839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.116304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:00.129258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:00.130427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:20:00.131595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:00.132417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 321/652] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:19:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:00.133163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.190531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd786da9-182c-499d-bbc8-db2cd2a77591 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.209002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.217300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.226521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.227247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.227425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.227721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.228454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:00.228722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.230080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.242327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 332/653] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:00.243016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.250927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90fc9-a6e8-45fb-99bf-0cde346980ad None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.290637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.291259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.291535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.291872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.292628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=f1b5bd02365348098c1e7b448a996f12) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:00.292939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.294378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.311647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 322/654] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/role_assignments?user.id=f1b5bd02365348098c1e7b448a996f12&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:00.311647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.374358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3717ed-502f-423d-b773-b8da73d6bb78 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.415181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.416268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.416706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.417145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.417475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdef0-e77a-4b6a-bb26-6fde573fd446 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.418247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:00.418561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.420461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.445186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 333/655] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:00.446126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.451456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.459031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.459712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.460003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.460276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.461307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:00.461619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.463107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.487692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 323/656] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:00.487692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.510001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.587670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215121e4-364a-4c10-a65b-bc201a655ecd None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.604562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81722-2f6b-4999-a62d-be371167a626 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.637080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.638185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.638944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.639694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.646094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.646723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.647000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.647272 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.649543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.652198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:00.670864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:00.671904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 06:20:00.672856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:00.675851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 334/657] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:00.676787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.719483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.734627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.739671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.824758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374541e-2c23-44c1-9b68-2943aefec0a5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.828180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.849325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 324/658] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:00.850468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.873145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024d461-6b9a-4707-97ac-a27d93f3518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.873805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024d461-6b9a-4707-97ac-a27d93f3518d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.874096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024d461-6b9a-4707-97ac-a27d93f3518d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.874373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024d461-6b9a-4707-97ac-a27d93f3518d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.943832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.959200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d37064-e70f-4adb-afbe-2bd5a561abe7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.968948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024d461-6b9a-4707-97ac-a27d93f3518d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.970722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024d461-6b9a-4707-97ac-a27d93f3518d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.006047 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.006847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.007128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.007495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.008677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:01.009010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:01.010455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.034652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 325/659] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:01.034652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.090174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 335/660] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:01.096855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6e65-517f-450b-ae57-18213dc8ba94 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.097224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6e65-517f-450b-ae57-18213dc8ba94 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.097632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6e65-517f-450b-ae57-18213dc8ba94 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.099713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 336/661] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:01.100829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d6e65-517f-450b-ae57-18213dc8ba94 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.105086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.144400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c058a8-fc3c-44ba-b981-bdfbb6acd8b0 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.179917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.180588 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.180866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.181132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.192546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:01.194055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.201995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.208933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d6e65-517f-450b-ae57-18213dc8ba94 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:01.210876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:01.212041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:01.213206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:01.213206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:01.213206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:01.213206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:01.220656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 326/662] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:01.221538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.253691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.254376 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.254659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.254930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.325353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca3cbd-49af-4c7d-b972-4ac35fe01494 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.340441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:01.341896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.345172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.362155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56de98-9aed-413b-9c58-7bcefb33a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.362799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56de98-9aed-413b-9c58-7bcefb33a577 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.363074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56de98-9aed-413b-9c58-7bcefb33a577 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.363345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56de98-9aed-413b-9c58-7bcefb33a577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.374701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56de98-9aed-413b-9c58-7bcefb33a577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:01.376181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56de98-9aed-413b-9c58-7bcefb33a577 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-9b56de98-9aed-413b-9c58-7bcefb33a577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:01.390419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:01.391403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:01.392346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:01.392346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:01.392346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:01.392346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:01.392346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 327/663] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:01.393068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb40be-9290-451f-b558-67db26ad5b6f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.393068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb40be-9290-451f-b558-67db26ad5b6f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.393411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb40be-9290-451f-b558-67db26ad5b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.413019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-44fb40be-9290-451f-b558-67db26ad5b6f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:01.414298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-44fb40be-9290-451f-b558-67db26ad5b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:01.451308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 337/664] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:01.452108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.470164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.493485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 328/665] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:01.494509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb40be-9290-451f-b558-67db26ad5b6f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.593814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13a57-0ab2-48b9-9a4c-42393d0f99d0 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.596670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.627313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb40be-9290-451f-b558-67db26ad5b6f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.632857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.633492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.633748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.634045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.634734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:01.635035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:01.636433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.655983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 338/666] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:01.657303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.673637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.674822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.675567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.676195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.677068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:01.677376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:01.678905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.703983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 329/667] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:01.704653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.747389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.775586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6113ed6-5e2a-4bbe-8c3b-e399e4185167 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.805483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5593c09-7752-46a5-a97e-6a66dc3eb43a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.811209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.811884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.812165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.812543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.824165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:01.825669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:01.840741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:01.840938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:01.841766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:01.847507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:01.847507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:01.847507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:01.847507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:01.847798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:01.847798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:01.847798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:01.848030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 339/668] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:01.848030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.858929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:01.864686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:01.865651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:01.866508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 330/669] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:01.867296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:01.867978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.964636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d8eec-fcd6-41b2-8fa7-1a240284d009 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:01.985845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:01.989745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d73c-d504-450c-907e-e85caa6be582 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.017163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.018258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.018544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.018823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.031464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.032989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.039676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.039676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.039676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.039676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:02.045818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:02.046732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:02.048169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 340/670] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:02.048685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.054215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.055767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:02.068085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:02.068966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:02.069851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 331/671] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:02.071247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.138721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:02.165542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed3e6-e0b3-4880-8dc0-eec844ff94bd None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.185300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2112b-ec0f-46af-8934-47a3d365d8c5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.200500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.201126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.201408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.201682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.202360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.202659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.204059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.216158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 341/672] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:02.216925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.234884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.235510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.235822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.236091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.236801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.237103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.238795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.247132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 332/673] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:02.247973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.274491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:02.340154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1e1ce-f171-4939-9ec6-6f0e6ebb552f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.353625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e386c69-10f3-4646-8e3a-a705281efbc6 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.382682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.383870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.384216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.384498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.385246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.385552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.387278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.388730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.389357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.389633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.389905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.390135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:02.390640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.391103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.392560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.402306 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 342/674] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:02.403431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.410601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 333/675] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:02.411738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.499065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:02.512713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed728c2-3bbe-48e5-b8bd-067c431fcb5c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.517730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edc929-98fd-4c28-9fa1-5837b1390c07 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.547812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.548481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.548758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.549033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.555919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.557365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.558638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18694a-be59-403f-9589-33755339345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.559533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18694a-be59-403f-9589-33755339345d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.559950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18694a-be59-403f-9589-33755339345d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.560349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18694a-be59-403f-9589-33755339345d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:02.569068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:02.570083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 343/676] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:02.571207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.574757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18694a-be59-403f-9589-33755339345d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.577208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18694a-be59-403f-9589-33755339345d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3a18694a-be59-403f-9589-33755339345d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:02.598083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:02.599015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:02.599978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:02.599978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:02.599978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:02.599978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:02.606420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 334/677] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:02.607430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18694a-be59-403f-9589-33755339345d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.631877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:02.676462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707c332-7912-49f3-ab08-8ce34b173254 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.710072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40829-b463-4051-b80e-aec2e96aebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.710717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40829-b463-4051-b80e-aec2e96aebc7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.710982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40829-b463-4051-b80e-aec2e96aebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.711251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40829-b463-4051-b80e-aec2e96aebc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.712053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40829-b463-4051-b80e-aec2e96aebc7 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=d1e0e81d0ee04020b43c28347ef3ab6c) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.712361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40829-b463-4051-b80e-aec2e96aebc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.713200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18694a-be59-403f-9589-33755339345d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.713783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40829-b463-4051-b80e-aec2e96aebc7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.720173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 344/678] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/role_assignments?user.id=d1e0e81d0ee04020b43c28347ef3ab6c&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:02.721246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902847-5ca3-48c2-97c1-e6e7ad57809f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.721587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902847-5ca3-48c2-97c1-e6e7ad57809f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.721788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902847-5ca3-48c2-97c1-e6e7ad57809f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.727090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 345/679] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:02.727090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53902847-5ca3-48c2-97c1-e6e7ad57809f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.758493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.759058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.759343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.759638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.760473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=0c08bdb04cc146fa8f6c6bb626c30437) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.760789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.762369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.764668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:02.770940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 335/680] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/role_assignments?user.id=0c08bdb04cc146fa8f6c6bb626c30437&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:02.772224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:02.895835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53902847-5ca3-48c2-97c1-e6e7ad57809f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.922209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d4f2-c767-453e-9100-2980b106d691 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:02.922894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:02.941980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8515-0be6-4e07-8375-00973247e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.943294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8515-0be6-4e07-8375-00973247e40a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.944427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8515-0be6-4e07-8375-00973247e40a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.949149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8515-0be6-4e07-8375-00973247e40a None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.950107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8515-0be6-4e07-8375-00973247e40a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.950107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8515-0be6-4e07-8375-00973247e40a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.951637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8515-0be6-4e07-8375-00973247e40a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.971699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 346/681] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:02.971699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac5492-0bc9-4e63-be0b-4367dae5e360 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.971699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac5492-0bc9-4e63-be0b-4367dae5e360 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.971699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac5492-0bc9-4e63-be0b-4367dae5e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.977918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:02.979744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:02.980038 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:02.980320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:02.981035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:02.981340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:02.983001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:02.997164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5fac5492-0bc9-4e63-be0b-4367dae5e360 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:02.998980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5fac5492-0bc9-4e63-be0b-4367dae5e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:03.000840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 336/682] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:03.001811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.075185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:03.090234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 347/683] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:03.092405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac5492-0bc9-4e63-be0b-4367dae5e360 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.136171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acc31b-77d2-4557-bdf8-0906e4baeceb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.179937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.180587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.180858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.181135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.182321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=c206251915e74dba98b9422cf2f026d2) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:03.182637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.184401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.196777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 337/684] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/role_assignments?user.id=c206251915e74dba98b9422cf2f026d2&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:03.198009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.277244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac5492-0bc9-4e63-be0b-4367dae5e360 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.340548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:03.386255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c10c-7c2b-4ea9-8177-9f9e8cc699e7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.390220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.391158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.391660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.392146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] PATH_INFO: `/v3/users/swift` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.404117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.405808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.419926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:03.420410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:03.421358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:03.422355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 348/685] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:03.427327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.439438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.440197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.440487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.440768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.458055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:03.465210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:03.466436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:03.467457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 338/686] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:03.473671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.558484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d626b-81f0-4dca-bb66-02082b40656c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.599646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.600396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.600743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.601124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.602014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:03.602388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.603900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.614594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebc9ef-3278-4dd7-a3a5-f75b8c4d5a30 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.633914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 349/687] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:03.639332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.671394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:03.700392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.701040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.701319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.701594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.702331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:03.702676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.706374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.721295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 339/688] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:03.730202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.782697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:03.785250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d6cb5-6c5b-4d6c-b9fa-2727ec014924 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.842835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.843936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.844427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.844914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.891592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f1601-5b5d-4b94-b4fb-a1710fb11d1d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.944998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.946024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.946521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.947353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.963794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.964794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.966464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.968213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:03.992657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:03.993609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:03.994509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:03.994509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:03.994509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:03.994509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:03.998147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 340/689] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:04.004746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.029890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:04.162941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 350/690] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 06:20:04.171104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.192042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:04.201762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42328921-1116-4645-9c87-f7f21bf53a88 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:04.264197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:04.264828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:04.265105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:04.265376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:04.266074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:04.266374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:04.267782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:04.291509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 341/691] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:04.299547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.373002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029877-d32c-42f6-b198-a1f7301ff100 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:04.407866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:04.417657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:04.418566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:04.419078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:04.419548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:04.424673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc83df8-0441-41b3-a70e-21ecd5cb4183 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:04.430679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:04.432430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:04.448252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:04.449196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:04.450166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:04.450166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:04.450166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:04.450166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:04.452413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 351/692] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:04.459674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.468668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:04.469333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:04.469615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:04.469888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:04.486440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:04.487944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:04.510130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:04.511133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:04.512159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:04.513382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 342/693] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:20:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:04.520412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.565531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:04.648161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc72a-4467-4145-ba3c-f6ad037795cc None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:04.700639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:04.701351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:04.701644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:04.701919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:04.702618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:04.702924 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:04.704402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:04.718153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 352/694] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:04.724790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.735635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34981dc4-a6c1-4568-baa6-9c25c7475985 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:04.802842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:04.806707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:04.807406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:04.807717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:04.807993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:04.808801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:04.809111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:04.810567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:04.842261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 343/695] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:20:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:04.847938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.923637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d129ee-9a85-4865-b315-ce03c49c5367 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:04.971211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:04.978724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e24f-048f-4255-a879-a423c1258010 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:05.006366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.007081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.007423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.007724 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.028879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.035643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.047550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c7b68-d9b9-4c73-8131-e7fa8a284511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.048212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7b68-d9b9-4c73-8131-e7fa8a284511 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.048495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7b68-d9b9-4c73-8131-e7fa8a284511 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.048767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7b68-d9b9-4c73-8131-e7fa8a284511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:05.052524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:05.053413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:05.054368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:05.060330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 353/696] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:05.061257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:05.186679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:05.190831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a3b71-41d7-47eb-a49c-1f3969c44657 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:05.201342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c7b68-d9b9-4c73-8131-e7fa8a284511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.202812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c7b68-d9b9-4c73-8131-e7fa8a284511 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.231726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81694525-a579-4eb7-8d21-2fd6f96693bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.232294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694525-a579-4eb7-8d21-2fd6f96693bf None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.232580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694525-a579-4eb7-8d21-2fd6f96693bf None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.232918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694525-a579-4eb7-8d21-2fd6f96693bf None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.233669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81694525-a579-4eb7-8d21-2fd6f96693bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:05.233976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81694525-a579-4eb7-8d21-2fd6f96693bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.235402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81694525-a579-4eb7-8d21-2fd6f96693bf None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.252553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 354/697] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:05.252553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3478cd-6108-49f0-96c9-5c68387922a4 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.252553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3478cd-6108-49f0-96c9-5c68387922a4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.252553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3478cd-6108-49f0-96c9-5c68387922a4 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.252553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 355/698] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:05.252553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540b2f9-1d3f-4670-98cf-0a180657ebfc None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.253063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540b2f9-1d3f-4670-98cf-0a180657ebfc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.253063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540b2f9-1d3f-4670-98cf-0a180657ebfc None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.254538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 356/699] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:05.256238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540b2f9-1d3f-4670-98cf-0a180657ebfc None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:05.292931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:05.322431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 344/700] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:05.323772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f91d5-d03c-475b-87f5-b64f56a9b69c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.324063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f91d5-d03c-475b-87f5-b64f56a9b69c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.324343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f91d5-d03c-475b-87f5-b64f56a9b69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.346733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d52f91d5-d03c-475b-87f5-b64f56a9b69c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:05.348336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d52f91d5-d03c-475b-87f5-b64f56a9b69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:05.372163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540b2f9-1d3f-4670-98cf-0a180657ebfc None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:05.411641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.412417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.412820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.413078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.413876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=969f6ef78a6342e49325ea63f50b69ea) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:05.414181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.415778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.431644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 345/701] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:05.431644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482da2d-5b60-4f8f-814b-fc477576f224 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.431953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 357/702] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/role_assignments?user.id=969f6ef78a6342e49325ea63f50b69ea&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:05.431953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:05.432084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482da2d-5b60-4f8f-814b-fc477576f224 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.432634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482da2d-5b60-4f8f-814b-fc477576f224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.461778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2482da2d-5b60-4f8f-814b-fc477576f224 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:05.463022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2482da2d-5b60-4f8f-814b-fc477576f224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:05.474395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:05.556371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 346/703] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:05.556371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482da2d-5b60-4f8f-814b-fc477576f224 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:05.592735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67518389-d22c-441c-a3e8-279b4e3bf395 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:05.603515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:05.637462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e4bd2-4629-4007-a4d8-71364fb5770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.638159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e4bd2-4629-4007-a4d8-71364fb5770d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.638591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e4bd2-4629-4007-a4d8-71364fb5770d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.639041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e4bd2-4629-4007-a4d8-71364fb5770d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.655532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e4bd2-4629-4007-a4d8-71364fb5770d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.656961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e4bd2-4629-4007-a4d8-71364fb5770d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-639e4bd2-4629-4007-a4d8-71364fb5770d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:05.674919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:05.676081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:05.677355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:05.677355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:05.677355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:05.677355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:05.677355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 358/704] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:05.677860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8a24-1f78-4900-aade-18693b8c8916 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.677962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8a24-1f78-4900-aade-18693b8c8916 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.679200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8a24-1f78-4900-aade-18693b8c8916 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.681320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 359/705] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:05.681320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8a24-1f78-4900-aade-18693b8c8916 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:05.700989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482da2d-5b60-4f8f-814b-fc477576f224 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:05.739116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.739837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.740481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.740481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.740969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.742541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:05.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:05.754960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:05.755925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 347/706] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:05.757710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:05.772165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:05.797690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8a24-1f78-4900-aade-18693b8c8916 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:05.834451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8655f7d-88e3-49ae-98b7-dc7d061fb2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.835010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655f7d-88e3-49ae-98b7-dc7d061fb2e0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.835297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655f7d-88e3-49ae-98b7-dc7d061fb2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.835598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655f7d-88e3-49ae-98b7-dc7d061fb2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.847493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8655f7d-88e3-49ae-98b7-dc7d061fb2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.849507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8655f7d-88e3-49ae-98b7-dc7d061fb2e0 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-d8655f7d-88e3-49ae-98b7-dc7d061fb2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:05.864195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:05.866139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:05.866139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:05.866139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:05.866139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:05.866139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 360/707] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:05.867087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9da72-d118-4ede-abaf-5a15844729aa None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.867372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9da72-d118-4ede-abaf-5a15844729aa None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.867663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9da72-d118-4ede-abaf-5a15844729aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.872108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:05.876578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dad87-6d06-4818-85fd-ee1a45d60f75 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:05.886628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-c9d9da72-d118-4ede-abaf-5a15844729aa None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:05.887870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c9d9da72-d118-4ede-abaf-5a15844729aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:05.916886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:05.917645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:05.917927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:05.918193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:05.918890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:05.919187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:05.920606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:05.933897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 348/708] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:05.934637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:05.971958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 361/709] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:05.971958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9da72-d118-4ede-abaf-5a15844729aa None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.034259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:06.055600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbb03-319e-40ee-aa0e-7d7c7f723164 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.078037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9da72-d118-4ede-abaf-5a15844729aa None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.094288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.094854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.095226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.095502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.096250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:06.096555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.097948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.103264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 349/710] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:06.104019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.114804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.115429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.115760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.116042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.116778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:06.117076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.118418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.131682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 362/711] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:06.133407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:06.137684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.214495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb0257-aa21-4bc7-bcfa-e36e22b2c1fe None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.251805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07d85-edcb-424c-bd84-1c898e4bb83e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.256035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.256882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.257371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.257832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.265162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.266775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.270004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:06.279113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:06.280156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:06.281066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 350/712] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:06.282491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.298144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.298897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.299259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.299540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] PATH_INFO: `/v3/services/network` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.300216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.301585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:06.313303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:06.314626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:06.315465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 363/713] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:06 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:06.316643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.378806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:06.399602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7784-121c-4ffc-a30d-cd53ad1b64ba None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.419231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034e9eb-0d60-47dd-861e-977209ce2806 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.437014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.437632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.437911 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.438183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.438854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:06.439313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.440724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.446788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 351/714] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Jul 28 06:20:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:06.448124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.466129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.467188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.467678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.468351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.469243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.471105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.502380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 364/715] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:20:06 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:06.503513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.553202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:06.593933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfd895-1979-4518-97bc-b0df7fa9ebbb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.624281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35967e-0827-4ea3-b366-8ab2b02d2b0b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.635968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.636973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.637399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.637828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.638728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:06.639241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.641350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.657269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 352/716] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:06.666203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.672256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.672996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.673189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.673975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.674180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] RBAC: Adding query filter params (name=network) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:06.674491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.676002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.682289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 365/717] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:06.692769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:06.694088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:06.824799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c327543-2f65-4b21-a26f-5c1cb8e72963 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.834334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e17140-977a-4248-83fb-7e82b7f0aa76 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:06.844678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:06.869726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035adb4-59f9-4dc4-bd58-96294f425522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.870531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035adb4-59f9-4dc4-bd58-96294f425522 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.870736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035adb4-59f9-4dc4-bd58-96294f425522 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.871010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035adb4-59f9-4dc4-bd58-96294f425522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.871843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035adb4-59f9-4dc4-bd58-96294f425522 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=f1b5bd02365348098c1e7b448a996f12) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:06.872199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035adb4-59f9-4dc4-bd58-96294f425522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.873983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035adb4-59f9-4dc4-bd58-96294f425522 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.877511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeeb9b-af40-4b55-9cc2-c43d59af5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:06.878394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeeb9b-af40-4b55-9cc2-c43d59af5462 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:06.878877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeeb9b-af40-4b55-9cc2-c43d59af5462 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:06.879391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeeb9b-af40-4b55-9cc2-c43d59af5462 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:06.880299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeeb9b-af40-4b55-9cc2-c43d59af5462 None admin] RBAC: Adding query filter params (type=network) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:06.880805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeeb9b-af40-4b55-9cc2-c43d59af5462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:06.881189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 353/718] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:06 2022] GET /identity/v3/role_assignments?user.id=f1b5bd02365348098c1e7b448a996f12&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:06.882761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeeb9b-af40-4b55-9cc2-c43d59af5462 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:06.889784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 366/719] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:07.573597 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfcf2b-088f-4586-9e7b-6c166921cc8b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:07.573995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfcf2b-088f-4586-9e7b-6c166921cc8b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:07.574168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfcf2b-088f-4586-9e7b-6c166921cc8b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:07.575744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 354/720] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:07.581003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20827b3-f1b6-4d94-af1a-353e268a9fbb None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:07.581506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20827b3-f1b6-4d94-af1a-353e268a9fbb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:07.581973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20827b3-f1b6-4d94-af1a-353e268a9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:07.608637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a20827b3-f1b6-4d94-af1a-353e268a9fbb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:07.610190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a20827b3-f1b6-4d94-af1a-353e268a9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:07.694861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 367/721] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:07.746655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfcf2b-088f-4586-9e7b-6c166921cc8b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:07.849515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:07.890526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfcf2b-088f-4586-9e7b-6c166921cc8b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:07.935211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:07.935907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:07.936187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:07.936462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:07.953581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:07.958999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:07.959955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:07.960839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 355/722] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:07.966403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20827b3-f1b6-4d94-af1a-353e268a9fbb None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:08.131652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:08.139906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20827b3-f1b6-4d94-af1a-353e268a9fbb None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:08.186128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:08.186757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:08.187036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:08.187313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:08.188050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:08.188347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:08.189710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:08.203248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 368/723] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:08.211338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:08.345570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e997e59-c9f7-4201-995e-67ba23777bbd None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:08.388405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:08.395230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:08.395916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:08.396197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:08.396473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:08.410339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:08.411841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:08.433493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:08.434409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:08.435295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:08.435295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:08.435295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:08.435295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:08.435295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 356/724] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:08.440345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:08.619530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882890-4f49-4ad0-8287-e93c9a7ec383 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:08.666455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:08.667014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:08.667296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:08.667576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:08.668300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:08.668606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:08.669981 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:08.690190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 369/725] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:08.695466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:08.830101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01f06-5683-4fa4-87a6-f6a9129f4202 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:08.880441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d8c6e-e02e-43b2-8d25-4f3c2ceed881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:08.881118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8c6e-e02e-43b2-8d25-4f3c2ceed881 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:08.881349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8c6e-e02e-43b2-8d25-4f3c2ceed881 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:08.881622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8c6e-e02e-43b2-8d25-4f3c2ceed881 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:08.893736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8c6e-e02e-43b2-8d25-4f3c2ceed881 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:08.895189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8c6e-e02e-43b2-8d25-4f3c2ceed881 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-ca0d8c6e-e02e-43b2-8d25-4f3c2ceed881 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:08.910432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:08.911367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:08.912338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 357/726] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:08.917749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:08.951977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:09.027710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d8175-d4b6-4729-bac6-677cc9599223 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.028021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d8175-d4b6-4729-bac6-677cc9599223 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.028271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d8175-d4b6-4729-bac6-677cc9599223 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.029914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 358/727] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:09.041768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d047a9-1605-4893-bc1c-60549a75aacd None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.042055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d047a9-1605-4893-bc1c-60549a75aacd None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.042332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d047a9-1605-4893-bc1c-60549a75aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.079789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b0d047a9-1605-4893-bc1c-60549a75aacd None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:09.080992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b0d047a9-1605-4893-bc1c-60549a75aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:09.097288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5036-b1f8-4dd7-b1c9-7b615d325a05 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:09.153940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:09.165680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef51de8-6a0d-4d7f-979d-c441bb023cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:09.166330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef51de8-6a0d-4d7f-979d-c441bb023cf2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.166613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef51de8-6a0d-4d7f-979d-c441bb023cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.166891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef51de8-6a0d-4d7f-979d-c441bb023cf2 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.167717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef51de8-6a0d-4d7f-979d-c441bb023cf2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:09.168079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef51de8-6a0d-4d7f-979d-c441bb023cf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:09.174624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef51de8-6a0d-4d7f-979d-c441bb023cf2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:09.203658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 370/728] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Jul 28 06:20:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:09.203658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2788-5674-46b4-af9d-7d0b357d9aad None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.203658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2788-5674-46b4-af9d-7d0b357d9aad None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.203658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2788-5674-46b4-af9d-7d0b357d9aad None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.203658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 371/730] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:09.208136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2788-5674-46b4-af9d-7d0b357d9aad None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:09.208586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 359/730] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:09.209976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65ede-ba5a-44d1-a61c-45ec35385ffc None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.210290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65ede-ba5a-44d1-a61c-45ec35385ffc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.210596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65ede-ba5a-44d1-a61c-45ec35385ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.242847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-37d65ede-ba5a-44d1-a61c-45ec35385ffc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:09.244692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-37d65ede-ba5a-44d1-a61c-45ec35385ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:09.315773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:09.335716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 360/731] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:09.336662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65ede-ba5a-44d1-a61c-45ec35385ffc None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:09.360272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2788-5674-46b4-af9d-7d0b357d9aad None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:09.394622 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df238c-4184-47de-9f01-152924bdccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:09.395399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df238c-4184-47de-9f01-152924bdccc4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.395712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df238c-4184-47de-9f01-152924bdccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.395992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df238c-4184-47de-9f01-152924bdccc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.457419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65ede-ba5a-44d1-a61c-45ec35385ffc None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:09.458874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:09.468549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df238c-4184-47de-9f01-152924bdccc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:09.470018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df238c-4184-47de-9f01-152924bdccc4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:09.495310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:09.495971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.496253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.496524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.497212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:09.498677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:09.519670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 361/732] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:09 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:09.519670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:09.567877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:09.599017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 372/733] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:09.601026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9168dd-e179-49b1-b94a-332f6f00f8a8 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.601543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9168dd-e179-49b1-b94a-332f6f00f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.601995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9168dd-e179-49b1-b94a-332f6f00f8a8 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.603983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 373/734] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:09.605473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4472b8-addb-4320-aa09-9cf462ca7747 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.605961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4472b8-addb-4320-aa09-9cf462ca7747 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.606478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4472b8-addb-4320-aa09-9cf462ca7747 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.608026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 374/735] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:09.608982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4472b8-addb-4320-aa09-9cf462ca7747 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:09.673169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e472af9-5eec-489d-b5f3-1e7dbced8b19 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:09.713844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df30ef-a880-45a7-9bab-f0f86e97ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:09.714518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df30ef-a880-45a7-9bab-f0f86e97ad58 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.714786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df30ef-a880-45a7-9bab-f0f86e97ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.715310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df30ef-a880-45a7-9bab-f0f86e97ad58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.726811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df30ef-a880-45a7-9bab-f0f86e97ad58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:09.726983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4472b8-addb-4320-aa09-9cf462ca7747 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-e5df30ef-a880-45a7-9bab-f0f86e97ad58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:09.731819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:09.732771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:09.733612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 362/736] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:20:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:09.734841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befc43-3784-4745-9f39-ecb5cf50a356 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.734942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befc43-3784-4745-9f39-ecb5cf50a356 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.735146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befc43-3784-4745-9f39-ecb5cf50a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.760221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a4befc43-3784-4745-9f39-ecb5cf50a356 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:09.761454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a4befc43-3784-4745-9f39-ecb5cf50a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:09.777249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:09.843677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 363/737] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:09.843677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabc4c7-ac4b-4146-a0b2-7268d87f7774 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.843677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabc4c7-ac4b-4146-a0b2-7268d87f7774 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.843677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabc4c7-ac4b-4146-a0b2-7268d87f7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.865322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ffabc4c7-ac4b-4146-a0b2-7268d87f7774 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:09.866974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ffabc4c7-ac4b-4146-a0b2-7268d87f7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:09.887133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:09.887818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:09.888095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:09.888367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:09.899006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:09.900460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:09.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:09.916400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:09.917404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:09.917404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:09.917404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:09.917404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:09.917404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 375/738] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:09.917404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:09.946407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 364/739] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 06:20:09.948892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabc4c7-ac4b-4146-a0b2-7268d87f7774 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:09.963668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.026461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a1fd5-0ad6-4d0f-92d1-33a7177f8c94 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.036326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.060903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabc4c7-ac4b-4146-a0b2-7268d87f7774 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.063497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.064229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.064512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.064787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.065497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:10.065801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.067165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.076490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 376/740] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:10.081799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.102692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.103695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.103980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.104257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.115988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:10.122040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:10.122991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:10.123894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:10.124550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 365/741] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:10.125521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.183566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.194472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea21590-ce09-4fa0-98e4-054d00e5ff33 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.228745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.229377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.229659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.229935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.230638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:10.230923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.232328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.236019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5a2d-5b2e-4107-b516-6c18a456630d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.244027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 377/742] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:10.244865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.274420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.275063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.275416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.275696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.276350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.277799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.287912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.296096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 366/743] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:10 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:10.297219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.360470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65ef63-2c70-4409-aec2-91767fcaad6f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.414498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.414898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.415297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.415725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.427950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.429613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.441698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:10.451972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:10.452973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:10.454032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:10.454032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:10.454032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:10.454032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:10.454032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 378/744] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:10.455164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.458760 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575886d-1461-4550-a241-4239f5f77327 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.500377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.501016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.501300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.501574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.502301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:10.502602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.504182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.514251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 367/745] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:10.515110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.584181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.594089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ec95f-a0fc-4125-a1aa-1a1c79b727a1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.631868 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0de4c-0ff8-42cf-b5d1-2c1e112b3418 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.643208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.644385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.644798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.645210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.656309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.657762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:10.669754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:10.670678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:10.671562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 379/746] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:10.672261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.673728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.674860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.675338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.676766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.677632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:10.678124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.679978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.700400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 368/747] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:10.702165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.747913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.804617 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72772d8-f2f1-4a73-9de5-430c1c7d5dac None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.808836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0800c-c4ba-41a0-b094-14400cb51271 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.840460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:10.844769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.845429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.845707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.845983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.853951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:10.854911 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:10.855865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:10.856316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:10.857474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:10.857627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.858119 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:10.859049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.860115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:10.873659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:10.874569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:10.875446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:10.875446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:10.875446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:10.875446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:10.875446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 380/748] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:10.876019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.876959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 369/749] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:10.881163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:10.985022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee3cb-f42d-4716-8463-ca7257c40b40 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:10.991112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eae0bb-120f-44e7-8b77-2ffa758c8842 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.002454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:11.028217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.028969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.029203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.029400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.030098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:11.030405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.031664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.031804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.032655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.033122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.033578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.041806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.043519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.045674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 370/750] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:11.046747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:11.055762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:11.056741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:11.057676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:11.060260 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 381/751] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:20:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:11.061271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.092045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:11.158153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daac5b8-ad19-4415-a758-d52e4dcfcb7d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.162326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0ddb-1a99-4d4c-84f0-1d1793473e22 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.195844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.196473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.197104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.197391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.197749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.198240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=969f6ef78a6342e49325ea63f50b69ea) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:11.198548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.199013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.199476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.199978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.200095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.206349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 371/752] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/role_assignments?user.id=969f6ef78a6342e49325ea63f50b69ea&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:11.207295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.209088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.210600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:11.240477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:11.241625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:11.242567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:11.246147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 382/753] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:11.253701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.330884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:11.408762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e857963-0603-4015-a8d8-2940893be7f6 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.411075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:11.421948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b5b0-ab87-4ef4-adf0-18b191afaa59 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.452776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.453424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.453704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.453974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.456623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:11.456941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.458430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.475346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.475689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.475966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.476238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.477034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:11.483169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.483169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.494124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 372/754] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:11.501587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 383/755] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:11.508675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.508811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.603654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:11.622947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d127b-6a64-405c-aa4e-c57511378d15 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.665433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dd7e2-2f19-4730-b0fb-cd9652caff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.665988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd7e2-2f19-4730-b0fb-cd9652caff7b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.666314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd7e2-2f19-4730-b0fb-cd9652caff7b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.666596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd7e2-2f19-4730-b0fb-cd9652caff7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.682653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de85d-7c6f-4351-add0-7a61572029a2 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.718352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007509a-7fcf-4040-9b74-e7791d3b8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.719008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007509a-7fcf-4040-9b74-e7791d3b8cad None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.719285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007509a-7fcf-4040-9b74-e7791d3b8cad None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.719559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007509a-7fcf-4040-9b74-e7791d3b8cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.729958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007509a-7fcf-4040-9b74-e7791d3b8cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.731416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007509a-7fcf-4040-9b74-e7791d3b8cad None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.742065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dd7e2-2f19-4730-b0fb-cd9652caff7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.743517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dd7e2-2f19-4730-b0fb-cd9652caff7b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-2007509a-7fcf-4040-9b74-e7791d3b8cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:11.746303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:11.747156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:11.748177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:11.748177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:11.748177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:11.748177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:11.752366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 373/756] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:11.753997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6b887-c435-4889-91d5-978de246b292 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.754304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6b887-c435-4889-91d5-978de246b292 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.754716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6b887-c435-4889-91d5-978de246b292 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.756185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 374/757] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:11.757067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6b887-c435-4889-91d5-978de246b292 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.776566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:11.848877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:11.865270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 384/758] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:11.866837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba261-f110-4e04-b572-1a020321647c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.867272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba261-f110-4e04-b572-1a020321647c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.867722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba261-f110-4e04-b572-1a020321647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.870196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6b887-c435-4889-91d5-978de246b292 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.887307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-49eba261-f110-4e04-b572-1a020321647c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:11.889018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-49eba261-f110-4e04-b572-1a020321647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:11.905863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.906541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.906772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.907036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.907757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:11.908061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.909438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.922110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 375/759] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:11.922950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.971819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 385/760] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:11.972952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba261-f110-4e04-b572-1a020321647c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.004166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:12.029220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155648ec-a642-4332-a5ba-adcaa5f5ff5a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.064397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.065085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.066057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.066057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.076695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.078243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:12.093714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:12.094832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:12.096014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:12.096014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:12.096014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:12.096014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:12.096967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 376/761] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:12.102041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba261-f110-4e04-b572-1a020321647c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.102528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.122041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:12.142429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.143358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.143868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.144289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.152572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.154364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:12.167681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:12.168786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:12.169833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:12.171934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 386/762] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:12.172968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.215691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d797e1-1cf8-46d6-89ee-a2c5b63c29e4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.241909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:12.251846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.252498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.252821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.253094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.253719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.255096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:12.264770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:12.265927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:12.266901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:12.270973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 377/763] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:12.271905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.286122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9ef9-f6eb-431e-a3da-a6bf0c8d1cd4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.322449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.323316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.323873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.324294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.325197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:12.325673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.327190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.340906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 387/764] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:12.342182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.379726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124623c-cb47-4a07-8cd1-dcf7d79de619 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.386426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:12.418232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.419190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.419609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.420044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.421101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:12.421596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.423323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.443707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 378/765] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:12.445147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.454250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93423-dd69-4d9a-a488-09592738298b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.491050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.491782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.492073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.492463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.493162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:12.493471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.494878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.500499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 388/766] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:12.502654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.614154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e03120-4a95-4abb-883d-2bdf985f9c36 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.616020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:12.621734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:12.650515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339b39-75dd-4e4f-90be-08d3492a416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.651334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339b39-75dd-4e4f-90be-08d3492a416e None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.651811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339b39-75dd-4e4f-90be-08d3492a416e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.652155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339b39-75dd-4e4f-90be-08d3492a416e None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/f1b5bd02365348098c1e7b448a996f12/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.654148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339b39-75dd-4e4f-90be-08d3492a416e None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=f1b5bd02365348098c1e7b448a996f12, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.655703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339b39-75dd-4e4f-90be-08d3492a416e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.669939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 389/767] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:20:12 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/f1b5bd02365348098c1e7b448a996f12/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:12.671220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101cb9e-a734-4729-8f1f-15cc2e2a83de None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.671510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101cb9e-a734-4729-8f1f-15cc2e2a83de None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.671848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101cb9e-a734-4729-8f1f-15cc2e2a83de None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.673320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 390/768] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:12.678293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101cb9e-a734-4729-8f1f-15cc2e2a83de None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.693200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83365-2e99-4729-b119-f6f09044f52c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.731936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ebb72-615a-4698-ad91-f841b576b139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.732622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ebb72-615a-4698-ad91-f841b576b139 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.733037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ebb72-615a-4698-ad91-f841b576b139 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.733322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ebb72-615a-4698-ad91-f841b576b139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.741830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ebb72-615a-4698-ad91-f841b576b139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.744258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ebb72-615a-4698-ad91-f841b576b139 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c69ebb72-615a-4698-ad91-f841b576b139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:12.759278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:12.760466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:12.761763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 379/769] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:12.762263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc6ac-bbc5-4030-a027-cae0dd7b8d72 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.762532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc6ac-bbc5-4030-a027-cae0dd7b8d72 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.762752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc6ac-bbc5-4030-a027-cae0dd7b8d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.782724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-afafc6ac-bbc5-4030-a027-cae0dd7b8d72 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:12.784144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-afafc6ac-bbc5-4030-a027-cae0dd7b8d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:12.819731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101cb9e-a734-4729-8f1f-15cc2e2a83de None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:12.877911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:12.878258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 380/770] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:12.879437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:12.879437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:12.879437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:12.879763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc6ac-bbc5-4030-a027-cae0dd7b8d72 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.879837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:12.880078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:12.881475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:12.891648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 391/771] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:12.897792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:12.934814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:12.937563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:13.003219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc6ac-bbc5-4030-a027-cae0dd7b8d72 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.034613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d37ab-ac3a-47fe-b217-5b6af43c5623 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.046057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.047273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.047793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.048222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.049015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:13.049320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.050762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.063329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 381/772] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:13.064256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.083435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.084103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.084380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.084649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.085464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] RBAC: Adding query filter params (interface=public, service_id=8bea24b7f6214887b2044080dff461a9, region_id=RegionOne) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:13.085766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.087125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.099793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 392/773] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:20:12 2022] GET /identity/v3/endpoints?service_id=8bea24b7f6214887b2044080dff461a9&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:13.100613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.186831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:13.190197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aae9df-1a86-4cd0-a99b-ef7d0cb4c2c1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.201911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:13.218612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a4f3-5493-4f0f-abe3-4165f06e22dc None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.231158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.232302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.232787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.233288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] PATH_INFO: `/v3/services/network` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.234155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.235994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:13.245949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:13.247008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:13.247888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:13.250900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 382/774] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:13.251893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.273480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.274969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.275345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.275775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.277092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=2cce71bab5154b19887ae23af182f2a7) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:13.277683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.279227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.291104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 393/775] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/role_assignments?user.id=2cce71bab5154b19887ae23af182f2a7&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:13.292464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.373624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe26b8-3b34-48bb-a7b9-ae7db77e95a7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.412983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c856cb-5e05-4679-9fbd-1a75f953b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.414016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c856cb-5e05-4679-9fbd-1a75f953b206 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.414443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c856cb-5e05-4679-9fbd-1a75f953b206 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.414861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c856cb-5e05-4679-9fbd-1a75f953b206 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.415790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c856cb-5e05-4679-9fbd-1a75f953b206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.417365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c856cb-5e05-4679-9fbd-1a75f953b206 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.423934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 383/776] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:13.425553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e22c0-9b82-4a0c-b71e-66f077c53599 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.426022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e22c0-9b82-4a0c-b71e-66f077c53599 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.426479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e22c0-9b82-4a0c-b71e-66f077c53599 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.428464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 384/777] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:13.437435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca63e6-2c67-4fce-b8c6-fe61449c7736 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.437659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca63e6-2c67-4fce-b8c6-fe61449c7736 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.437977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca63e6-2c67-4fce-b8c6-fe61449c7736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.440140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b79ab1-cccf-4d09-a937-3320add28d50 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.469449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7fca63e6-2c67-4fce-b8c6-fe61449c7736 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:13.470680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7fca63e6-2c67-4fce-b8c6-fe61449c7736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:13.521292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.521958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.522232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.522500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.523270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] RBAC: Adding query filter params (name=network) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:13.523575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.525503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.530927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:13.536377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 394/778] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:13.543099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.574552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:13.596345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 385/779] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:13.619564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca63e6-2c67-4fce-b8c6-fe61449c7736 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.669210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8773a-3c96-4f2d-aff8-34146d54185b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.706533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.707092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.707382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.707703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.708396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] RBAC: Adding query filter params (type=network) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:13.708706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.710128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.715917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 395/780] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:13.720883 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.751446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca63e6-2c67-4fce-b8c6-fe61449c7736 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.796286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.797577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.798461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.799077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.813517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:13.820407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:13.821363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:13.822587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:13.825107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:13.826500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 386/781] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:13.832749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.857019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:13.871642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c468f-fc0b-4f98-874b-173f4ab667cb None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:13.931774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:13.932431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:13.932709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:13.932983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:13.933750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] RBAC: Adding query filter params (interface=public, service_id=50f50ac6c96d41678a89e856a16da252, region_id=RegionOne) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:13.934061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:13.935495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:13.949978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 396/782] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/endpoints?service_id=50f50ac6c96d41678a89e856a16da252&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:13.957154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:13.986258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680714a4-f3ea-4f4d-ade3-4340e068ef35 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:14.036643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:14.037543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:14.039569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:14.044532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:14.045493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:14.046003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:14.047600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:14.064912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 387/783] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:14.070919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:14.115081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89949d0-7e4a-4333-aed2-bcb13088d244 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:14.180796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:14.182472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:14.183138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:14.184754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:14.186323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:14.188577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:14.200939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 397/784] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:13 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:14.233075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:14.260096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fed5a-543d-403d-8ff0-efbfc9d1d046 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:14.311291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:14.311997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:14.312279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:14.312554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:14.325183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:14.326677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:14.345740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:14.346709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:14.347580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:14.347580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:14.347580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:14.347580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:14.347580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 388/785] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:14.353105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:14.380088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:14.472062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c88775-74d2-48cc-bfd9-7247a1161662 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:14.506848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:14.507436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:14.507746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:14.508024 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:14.508775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:14.509087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:14.510465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:14.523906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 398/786] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:14.529648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:14.656600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08106e13-ece2-4f07-b94b-2bb4378398e4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:14.685855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:14.695310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:14.696447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:14.697411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:14.697693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:14.709993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:14.711498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:14.729405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:14.731523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:14.733706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 389/787] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:14.736414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:14.826427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:14.858221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe7535-e09b-4def-af8f-fa679076d775 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:14.893623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc08402-9063-4de1-adf0-b6120b0da966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:14.894284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08402-9063-4de1-adf0-b6120b0da966 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:14.894567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08402-9063-4de1-adf0-b6120b0da966 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:14.894844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08402-9063-4de1-adf0-b6120b0da966 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:14.895676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc08402-9063-4de1-adf0-b6120b0da966 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:14.895992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc08402-9063-4de1-adf0-b6120b0da966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:14.897471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc08402-9063-4de1-adf0-b6120b0da966 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:14.916934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 399/788] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Jul 28 06:20:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:14.924864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:14.979911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96aca-e650-4ff5-95cb-20e09d488ebd None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:14.980244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96aca-e650-4ff5-95cb-20e09d488ebd None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:14.980462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96aca-e650-4ff5-95cb-20e09d488ebd None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:14.982106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 400/789] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:15.000690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15037c02-12dc-4264-ac2f-93008cb30425 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.000982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15037c02-12dc-4264-ac2f-93008cb30425 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.001262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15037c02-12dc-4264-ac2f-93008cb30425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.035789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-15037c02-12dc-4264-ac2f-93008cb30425 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:15.037036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-15037c02-12dc-4264-ac2f-93008cb30425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:15.067869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e036ae-eb0e-4bb1-9ec7-cdfee1fe3c4a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:15.113432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:15.114014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.114295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.114568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.132875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:15.134341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:15.161817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:15.162843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:15.163792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:15.163792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:15.163792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:15.163792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:15.163792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 390/790] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:15.169418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:15.174228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 401/791] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:15.200664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15037c02-12dc-4264-ac2f-93008cb30425 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:15.267992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:15.331982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:15.357074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299a06-a8e7-408d-b285-9cb9f47c5bec None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:15.415002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15037c02-12dc-4264-ac2f-93008cb30425 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:15.432476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:15.433112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.433390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.433661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.434355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:15.434656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:15.436071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:15.458149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 391/792] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:15.464102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:15.465448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:15.466113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.466394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.466669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.492028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:15.504707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:15.506254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:15.507931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 402/793] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:15.525882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:15.615997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5b634-d7c2-43d1-8015-6dcc6b07b7c9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:15.652066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:15.656776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:15.657631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.658136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.658617 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.677938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:15.679376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:15.701706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:15.702664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:15.703548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:15.712025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 392/794] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:15.717681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:15.727903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53d78-f4b1-4454-89cb-623d16140747 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:15.752008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:15.770076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3443f9-564b-4d49-9417-4b6711f11530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:15.770711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3443f9-564b-4d49-9417-4b6711f11530 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.771018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3443f9-564b-4d49-9417-4b6711f11530 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.771278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3443f9-564b-4d49-9417-4b6711f11530 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.772461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3443f9-564b-4d49-9417-4b6711f11530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:15.772838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3443f9-564b-4d49-9417-4b6711f11530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:15.775092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3443f9-564b-4d49-9417-4b6711f11530 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:15.786840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 403/795] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:15.793039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf226f-a7b0-4bd9-9b91-cbb9cad10156 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.793393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf226f-a7b0-4bd9-9b91-cbb9cad10156 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.793602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf226f-a7b0-4bd9-9b91-cbb9cad10156 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.795180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 404/796] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:15.796649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf226f-a7b0-4bd9-9b91-cbb9cad10156 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:15.852179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d72c5a-7d06-4300-9b19-2517c59204ee None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:15.892909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c10705-cc76-43dd-b394-4b57923ec1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:15.893530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c10705-cc76-43dd-b394-4b57923ec1ed None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.893800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c10705-cc76-43dd-b394-4b57923ec1ed None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.894070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c10705-cc76-43dd-b394-4b57923ec1ed None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.894812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c10705-cc76-43dd-b394-4b57923ec1ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:15.895112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c10705-cc76-43dd-b394-4b57923ec1ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:15.896572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c10705-cc76-43dd-b394-4b57923ec1ed None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:15.905201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf226f-a7b0-4bd9-9b91-cbb9cad10156 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:15.914511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 393/797] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:15.914511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e7b2-dc13-4df9-acf5-b6180aeaf32a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.914511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e7b2-dc13-4df9-acf5-b6180aeaf32a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.914511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e7b2-dc13-4df9-acf5-b6180aeaf32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.929374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-58a1e7b2-dc13-4df9-acf5-b6180aeaf32a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:15.930499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-58a1e7b2-dc13-4df9-acf5-b6180aeaf32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:15.946382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce0d8a-88e6-49cc-88dc-f5a9c7eec224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:15.947727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:15.948448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0d8a-88e6-49cc-88dc-f5a9c7eec224 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.948870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0d8a-88e6-49cc-88dc-f5a9c7eec224 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.949274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0d8a-88e6-49cc-88dc-f5a9c7eec224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.960383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce0d8a-88e6-49cc-88dc-f5a9c7eec224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:15.961815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce0d8a-88e6-49cc-88dc-f5a9c7eec224 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-dfce0d8a-88e6-49cc-88dc-f5a9c7eec224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:15.975972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:15.976846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:15.977738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:15.977738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:15.977738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:15.977738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:15.977738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 405/798] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:15.978541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02af1c-4cf4-4737-93ba-b5e8890b32fb None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:15.978541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02af1c-4cf4-4737-93ba-b5e8890b32fb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:15.978878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02af1c-4cf4-4737-93ba-b5e8890b32fb None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:15.984154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 406/799] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:15.984960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02af1c-4cf4-4737-93ba-b5e8890b32fb None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.006756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 394/800] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:16.007832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1e7b2-dc13-4df9-acf5-b6180aeaf32a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.022008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:16.098594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02af1c-4cf4-4737-93ba-b5e8890b32fb None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.121573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1e7b2-dc13-4df9-acf5-b6180aeaf32a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.134658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f845c0-6130-4eda-a137-86a9ec8a5927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.135466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f845c0-6130-4eda-a137-86a9ec8a5927 None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.135768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f845c0-6130-4eda-a137-86a9ec8a5927 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.136043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f845c0-6130-4eda-a137-86a9ec8a5927 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/969f6ef78a6342e49325ea63f50b69ea/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.138107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f845c0-6130-4eda-a137-86a9ec8a5927 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=969f6ef78a6342e49325ea63f50b69ea, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.139688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f845c0-6130-4eda-a137-86a9ec8a5927 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.153835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 407/801] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:20:15 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/969f6ef78a6342e49325ea63f50b69ea/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:16.155175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5dbf-7c79-4633-9016-7bbeb4a92676 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.155462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5dbf-7c79-4633-9016-7bbeb4a92676 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.155768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5dbf-7c79-4633-9016-7bbeb4a92676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.156480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.157460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.157996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.158651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.159587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:16.160225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.162700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.177867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a5ab5dbf-7c79-4633-9016-7bbeb4a92676 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:16.179243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a5ab5dbf-7c79-4633-9016-7bbeb4a92676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:16.180117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 395/802] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:16.184983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.205402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:16.284162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 408/803] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:16.285594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab5dbf-7c79-4633-9016-7bbeb4a92676 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.325991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:16.331013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8261-e375-468c-b951-f073dae1be24 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.374777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.375535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.375952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.376314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.387509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:16.393025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:16.393940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:16.394786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 396/804] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:16.395473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.424499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab5dbf-7c79-4633-9016-7bbeb4a92676 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.465279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.466193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.466539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.467213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.476683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.478879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.488446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:16.494307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:16.495308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:16.496303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:16.497230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 409/805] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:16.502654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.529889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3070e2-da10-4bc0-aa1a-4cbc731003f5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.576216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.577801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.578234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.578685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.579743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.582427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:16.594678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:16.595876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 06:20:16.596954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:16.600060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 397/806] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:16.601193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.611116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:16.636693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f8957-de2c-4214-a1b7-db5f4b2a5f32 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.678952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.679582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.679891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.680171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.680888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:16.681185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.682543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.691445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 410/807] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:16.692299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.737781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff510-bf0b-4009-afb0-2773be7bc098 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.777912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.778546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.778827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.779106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.780037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:16.780344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.781783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.790491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:16.791816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c80a-9a17-4aa6-8002-d9b7e376f45e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.807005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 398/808] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:16.808007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.827045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c760c-b14a-4f28-81f6-2e5c606c6615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.827705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c760c-b14a-4f28-81f6-2e5c606c6615 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.827979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c760c-b14a-4f28-81f6-2e5c606c6615 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.828246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c760c-b14a-4f28-81f6-2e5c606c6615 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.828909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c760c-b14a-4f28-81f6-2e5c606c6615 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:16.829206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c760c-b14a-4f28-81f6-2e5c606c6615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.830566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c760c-b14a-4f28-81f6-2e5c606c6615 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.839759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 411/809] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:16.839759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8ab06-7216-418c-bde6-f46557e8c971 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.839759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8ab06-7216-418c-bde6-f46557e8c971 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.839759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8ab06-7216-418c-bde6-f46557e8c971 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.839759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 412/810] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:16.839759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8ab06-7216-418c-bde6-f46557e8c971 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:16.851743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:16.921153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b96cf9-97b2-464e-99ae-1ef630767592 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.944721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8ab06-7216-418c-bde6-f46557e8c971 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:16.956594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.957437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.957716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.957989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.969437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:16.970903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:16.981966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:16.982771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:16.983309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:16.983770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:16.986158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:16.987217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:16.988203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:16.988203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:16.988203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:16.988203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:16.988203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 399/811] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:16.988203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.041137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.069164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.070682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.081479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.098660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb34713-801b-4545-87b1-8b240bfbf10c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.133221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08ce38-eaff-4e54-bf44-2c01a042864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.133934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ce38-eaff-4e54-bf44-2c01a042864a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.134290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ce38-eaff-4e54-bf44-2c01a042864a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.134575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ce38-eaff-4e54-bf44-2c01a042864a None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.135257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08ce38-eaff-4e54-bf44-2c01a042864a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:17.135566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08ce38-eaff-4e54-bf44-2c01a042864a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.136975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08ce38-eaff-4e54-bf44-2c01a042864a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.141881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 400/812] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:17.143732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82adb-cae4-4573-9663-a69d6a639196 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.144165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82adb-cae4-4573-9663-a69d6a639196 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.144454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82adb-cae4-4573-9663-a69d6a639196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.164625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f2d82adb-cae4-4573-9663-a69d6a639196 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:17.165836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f2d82adb-cae4-4573-9663-a69d6a639196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:17.180115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 413/813] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:17.181192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.247467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 401/814] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:17.247467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d82adb-cae4-4573-9663-a69d6a639196 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.288840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ea213-bbbc-4c95-91e0-07aca7654e52 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.297510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.298738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.329518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.330158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.330450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.330723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.331418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:17.331755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.333162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.350487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 414/815] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:17.350487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.368545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d82adb-cae4-4573-9663-a69d6a639196 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.405355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.405985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.406293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.406534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.407238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.408664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.432122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 402/816] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:17.433320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.464420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293556-4de9-49cc-8c6b-c899cd351d3e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.515199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.516539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.517112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.517588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.530742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.532844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:17.550588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:17.551595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:17.552541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:17.552541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:17.552541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:17.552541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:17.554445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.559728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38150d8-c8f9-4c82-a566-a687758d5d4e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.560444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 415/817] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:17.562339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.588120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.605896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.606575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.606856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.607133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] PATH_INFO: `/v3/services/network` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.607936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.609354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:17.620327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:17.621400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 06:20:17.622845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:17.627227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 403/818] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:17.628225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.697851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277deda-8bd1-4885-bb57-bf7595bdfa8e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.745004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.746154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.746431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.746714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.757762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.759995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.761544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b12c9-fade-433d-8fae-1ea26a68e96d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:17.773488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:17.774641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:17.775905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 416/819] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:17.779751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.813348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.814496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.815050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.815910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.817035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:17.817744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.820161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.841280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 404/820] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:17.842422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.872706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.874504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:17.900425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a9632-c2cb-4895-ae2f-78f69b420ace None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.937093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.938108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.938624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.939043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.939895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:17.940346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:17.941992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:17.948060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 417/821] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:17.949109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:17.959384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6144f-5d6e-49c8-8874-e37c24dc9dee None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:17.995972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:17.996689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:17.997011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:17.997288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:17.998076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:17.998378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.000028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.029060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 405/822] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:18.029959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.058285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d8da0-11f7-4d80-b876-0e4c3ebf23f7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.095782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.097000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.097426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.097846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.105490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.107137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.110023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:18.115900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:18.122848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:18.123993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:18.125279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:18.128284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 418/823] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:18.129295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.141464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde3d55-cd00-4d75-a73b-9718f66ec5fc None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.177543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.178081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.178359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.178655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.179366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] RBAC: Adding query filter params (type=network) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:18.179690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.181153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.191100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 406/824] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:18.192121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.238040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f23361-6059-428b-9671-0a09ff821495 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.275574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.276232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.276509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.276781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.287503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.288972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.301002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236a7b-debb-4d56-925d-bb3fabfa1463 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:18.302997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:18.304003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:18.304888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:18.304888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:18.304888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:18.304888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:18.308962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 419/825] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:18.309541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.340069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1917981-3938-4b04-912e-c1529d453246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.340699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1917981-3938-4b04-912e-c1529d453246 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.340969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1917981-3938-4b04-912e-c1529d453246 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.341413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1917981-3938-4b04-912e-c1529d453246 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.341972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1917981-3938-4b04-912e-c1529d453246 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:18.342273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1917981-3938-4b04-912e-c1529d453246 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.343723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1917981-3938-4b04-912e-c1529d453246 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.355285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 407/826] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:18.357592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8619-701b-481c-9154-5814b0a10aff None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.358083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8619-701b-481c-9154-5814b0a10aff None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.358788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8619-701b-481c-9154-5814b0a10aff None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.360504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 408/827] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:18.367127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb8619-701b-481c-9154-5814b0a10aff None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.367325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:18.371954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:18.417079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9feaf9-f0f6-4465-b45e-a9a3b6fd35b3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.452845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.453471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.453750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.454022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.454719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.456141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.479227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 420/828] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:18.484956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.497586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb8619-701b-481c-9154-5814b0a10aff None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.538097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c8d6-6710-499d-9435-8dfb0676d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.539387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c8d6-6710-499d-9435-8dfb0676d90e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.539387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c8d6-6710-499d-9435-8dfb0676d90e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.539387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c8d6-6710-499d-9435-8dfb0676d90e None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.540012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c8d6-6710-499d-9435-8dfb0676d90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:18.540320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c8d6-6710-499d-9435-8dfb0676d90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.541731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c8d6-6710-499d-9435-8dfb0676d90e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.556345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 409/829] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:18.557764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6ac02-c7cf-401b-9db8-395a2307f25b None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.558055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6ac02-c7cf-401b-9db8-395a2307f25b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.558332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6ac02-c7cf-401b-9db8-395a2307f25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.579180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e2c6ac02-c7cf-401b-9db8-395a2307f25b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:18.580450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e2c6ac02-c7cf-401b-9db8-395a2307f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:18.631707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29f8b3-83e9-488d-b8ef-065d213b56ee None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.645762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:18.654214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:18.669713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 410/830] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:18.671039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6ac02-c7cf-401b-9db8-395a2307f25b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.682695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.683777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.684276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.684738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.685872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=f1b5bd02365348098c1e7b448a996f12) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:18.686380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.688136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.695931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 421/831] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/role_assignments?user.id=f1b5bd02365348098c1e7b448a996f12&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:18.704266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.794736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6ac02-c7cf-401b-9db8-395a2307f25b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.833023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804aeb9-9a5a-4ede-9922-4f1bb024a5dc None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:18.845595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.847143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.847143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.847143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.857032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:18.859127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:18.875649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:18.876863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:18.877967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:18.879651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 411/832] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:18.881922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:18.882602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:18.882881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:18.883173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:18.885168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.900676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:18.906613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:18.907608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:18.908482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:18.912032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 422/833] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:18.914447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:18.953475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:18.957915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:19.021850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef066a6-7863-42c1-a5d0-5e025e4f8608 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.038634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e6c6f-1ba6-4264-bf03-fd97a002096f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.070434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.070982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.071251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.071527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.072674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:19.072971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.074416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.086151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.087085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.087391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 412/834] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:19.087811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.088290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.089200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:19.089691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.091259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.093178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.101397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 423/835] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:19.107761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.200720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349521d0-4fc2-4b9b-998e-739dbb7aec38 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.207313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:19.215126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d3ad8-7a4e-4131-8bb5-521b47e3cef5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.215608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:19.247725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.249243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.249800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.250322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/2cce71bab5154b19887ae23af182f2a7/roles/2ceab442c0cc49b5ad07767f77f687fe` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.255054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.255842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.256219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.256587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.269486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.269962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=2cce71bab5154b19887ae23af182f2a7, role_id=2ceab442c0cc49b5ad07767f77f687fe)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.271170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.271754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.288324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 413/836] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:20:19 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/2cce71bab5154b19887ae23af182f2a7/roles/2ceab442c0cc49b5ad07767f77f687fe => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:19.288948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:19.290014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:19.291129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:19.291129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:19.291129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:19.291129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:19.295688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 424/837] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:19.298578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.419443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a600-f5de-48b5-afa3-b6660c394082 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.457838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ef9f9-5c15-4dd8-af36-e6740167d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.458479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef9f9-5c15-4dd8-af36-e6740167d56e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.458762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef9f9-5c15-4dd8-af36-e6740167d56e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.459089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef9f9-5c15-4dd8-af36-e6740167d56e None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.459822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef9f9-5c15-4dd8-af36-e6740167d56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:19.460169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef9f9-5c15-4dd8-af36-e6740167d56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.461566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef9f9-5c15-4dd8-af36-e6740167d56e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.476963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 414/838] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:19.480749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.547443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728fb91-70c6-4f83-a7b1-f479345d6926 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.547768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728fb91-70c6-4f83-a7b1-f479345d6926 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.548050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728fb91-70c6-4f83-a7b1-f479345d6926 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.549652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 415/839] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:19.554625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d064-4d08-4684-92f8-2a21431a178d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.554911 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d064-4d08-4684-92f8-2a21431a178d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.555192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d064-4d08-4684-92f8-2a21431a178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.574452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b8d7d064-4d08-4684-92f8-2a21431a178d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:19.575900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b8d7d064-4d08-4684-92f8-2a21431a178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:19.589429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0021b6-8f2a-46e0-856f-026187e8bfa4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.594241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:19.629398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.630053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.630330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.630605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.639709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.641166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:19.653197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:19.654187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:19.655125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 425/840] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:19.660815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.666975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 416/841] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:19.675486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:19.698595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d064-4d08-4684-92f8-2a21431a178d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.793304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a598a-c4c6-4f70-b511-b650a01b34b6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.824106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d064-4d08-4684-92f8-2a21431a178d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.843291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.844412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.845414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.845905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.847158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:19.847911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.850203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.865121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:19.865783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:19.866086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:19.866363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:19.866998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:19.868395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:19.873988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 426/842] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Jul 28 06:20:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:19.882478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:19.883509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:19.884403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:19.885125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.885197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 417/843] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:19.885197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:19.902465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:19.945448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:19.985015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fabdf2-70b9-4566-8c29-150baf2b17fa None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:19.997275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bf1a9-c7d4-4e30-94cd-5489ad6dd8aa None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:20.027917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:20.029116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.029912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.030333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.045728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:20.046634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.047215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.047657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.048963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:20.049516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:20.051225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:20.057822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 418/844] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:20.064073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:20.106044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:20.107686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:20.158241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:20.170800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:20.182438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492171-6bc9-45a7-ad42-00195068e6b8 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:20.212365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 427/845] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:20.217701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:20.225982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:20.226625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.226912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.227190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.227929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:20.228233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:20.230087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:20.236766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 419/846] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:20.335181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c11024-ee62-4373-8d0f-9bda1d848c93 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:20.373884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:20.374816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.375284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.375732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.387739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:20.389570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:20.405519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:20.406459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:20.407358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:20.407358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:20.407358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:20.407358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:20.411478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 428/847] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:20.415382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:20.524476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c76d2f-2669-4eab-bbce-bd1efb966302 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:20.559082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:20.559751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.560032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.560353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.561052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:20.561354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:20.562832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:20.579749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 420/848] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:20.581802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:20.602987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:20.690441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b9a2-3433-4ab6-833a-1ed0967a44c9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:20.726478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad96f11-2409-4f8b-8dd9-7925502561bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:20.727140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96f11-2409-4f8b-8dd9-7925502561bd None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.727423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96f11-2409-4f8b-8dd9-7925502561bd None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.727726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96f11-2409-4f8b-8dd9-7925502561bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.734842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad96f11-2409-4f8b-8dd9-7925502561bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:20.736393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad96f11-2409-4f8b-8dd9-7925502561bd None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4ad96f11-2409-4f8b-8dd9-7925502561bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:20.748353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:20.752168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:20.753064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:20.753910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 429/849] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:20.756114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:20.759919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:20.863915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d343-90c6-47b9-9540-efd7d4824df1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:20.899684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:20.900512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf226ff-93f8-4bd3-a1a4-66df3c18c933 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.900800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf226ff-93f8-4bd3-a1a4-66df3c18c933 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.901076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf226ff-93f8-4bd3-a1a4-66df3c18c933 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.901348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.901839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.902333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.902684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 430/850] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:20.903579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:20.904142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:20.905805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:20.907340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380753f-419d-4b91-9af7-1fb7cf81d774 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:20.907644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380753f-419d-4b91-9af7-1fb7cf81d774 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:20.907942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380753f-419d-4b91-9af7-1fb7cf81d774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:20.927713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7380753f-419d-4b91-9af7-1fb7cf81d774 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:20.927936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7380753f-419d-4b91-9af7-1fb7cf81d774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:20.928421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 421/851] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:20.931887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:21.003086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:21.005761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 431/852] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:21.028986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380753f-419d-4b91-9af7-1fb7cf81d774 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:21.050589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49f267-91e0-4b9c-b585-3b7ce7d3b436 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:21.067992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:21.089028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:21.089821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.090221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.090644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.091749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=969f6ef78a6342e49325ea63f50b69ea) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:21.092182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:21.093829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:21.107835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 422/853] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:20 2022] GET /identity/v3/role_assignments?user.id=969f6ef78a6342e49325ea63f50b69ea&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:21.132162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380753f-419d-4b91-9af7-1fb7cf81d774 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:21.169680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:21.170494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.170772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.171043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.171704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:21.173099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:21.183034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:21.185167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:21.187155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 432/854] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Jul 28 06:20:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:21.195672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:21.298811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1093-1e57-4f95-9066-8a11ab5ba553 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:21.325271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:21.335050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b395b-4d4a-4e7e-a8ba-e839c5a5de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:21.335695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b395b-4d4a-4e7e-a8ba-e839c5a5de71 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.335996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b395b-4d4a-4e7e-a8ba-e839c5a5de71 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.336248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b395b-4d4a-4e7e-a8ba-e839c5a5de71 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.336895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b395b-4d4a-4e7e-a8ba-e839c5a5de71 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:21.337198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b395b-4d4a-4e7e-a8ba-e839c5a5de71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:21.338568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b395b-4d4a-4e7e-a8ba-e839c5a5de71 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:21.345641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 423/855] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:21.351721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:21.429738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:21.441487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b08a0-122f-4e4f-8d19-ca7b9219ea6e None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.441487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b08a0-122f-4e4f-8d19-ca7b9219ea6e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.441487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b08a0-122f-4e4f-8d19-ca7b9219ea6e None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.442412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 424/856] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:21.448737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487b5f3-e517-42a9-a0d6-af0e803d8bee None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.449357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487b5f3-e517-42a9-a0d6-af0e803d8bee None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.449845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487b5f3-e517-42a9-a0d6-af0e803d8bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.466591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948899-c14e-4c55-89ba-1b602081d80b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:21.469369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2487b5f3-e517-42a9-a0d6-af0e803d8bee None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:21.470878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2487b5f3-e517-42a9-a0d6-af0e803d8bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:21.502607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:21.503718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.504258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.504808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.505765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:21.506261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:21.508026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:21.513397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 433/857] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:21.546089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 425/858] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:21.569571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:21.684520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda21ff8-666d-4dba-819b-e81899347a9e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:21.721014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:21.721655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.721928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.722199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.724245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:21.737716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:21.744867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:21.745865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:21.746723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 434/859] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:20:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:21.754375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487b5f3-e517-42a9-a0d6-af0e803d8bee None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:21.865697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487b5f3-e517-42a9-a0d6-af0e803d8bee None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:21.886880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:21.910059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:21.911008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:21.911464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:21.911974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:21.912902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:21.913380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:21.914937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:21.924149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 426/860] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:20:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:21.930255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:22.040166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb86a-e978-471d-ba62-cebe86952f45 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:22.079168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:22.079852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.080134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.080407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.091952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:22.093417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:22.108670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:22.109590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:22.110471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:22.110471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:22.110471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:22.110471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:22.110471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 435/861] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:22.115939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:22.221823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c048f9-7a5d-4285-9826-7f7e04f6b984 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:22.256668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35355482-cdd2-43c8-a6a3-a3a622fb86ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:22.257318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355482-cdd2-43c8-a6a3-a3a622fb86ce None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.257600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355482-cdd2-43c8-a6a3-a3a622fb86ce None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.257871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355482-cdd2-43c8-a6a3-a3a622fb86ce None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.258564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35355482-cdd2-43c8-a6a3-a3a622fb86ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:22.258864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35355482-cdd2-43c8-a6a3-a3a622fb86ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:22.260328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35355482-cdd2-43c8-a6a3-a3a622fb86ce None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:22.273906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 427/862] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:22.279533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:22.334084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:22.393616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8d7e-835d-4e7a-82f9-b17794ffb0ce None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:22.406159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466257-9388-4387-bca6-4b9074c4d25b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.406752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466257-9388-4387-bca6-4b9074c4d25b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.406752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466257-9388-4387-bca6-4b9074c4d25b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.411902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 428/863] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:22.413525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6456a-6d8f-4e80-ab5b-116b8dba9d02 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.413809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6456a-6d8f-4e80-ab5b-116b8dba9d02 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.414073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6456a-6d8f-4e80-ab5b-116b8dba9d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.431422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:22.432253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.432537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.432808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.432972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d2f6456a-6d8f-4e80-ab5b-116b8dba9d02 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:22.434037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d2f6456a-6d8f-4e80-ab5b-116b8dba9d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:22.442497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:22.444471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:22.460684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:22.462614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:22.464019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 436/864] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:20:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:22.468345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:22.477578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:22.519759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 429/865] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:22.536598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6456a-6d8f-4e80-ab5b-116b8dba9d02 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:22.592149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2a08-81c5-41dd-8997-3dac7c59f4ee None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:22.603237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:22.641422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:22.642668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.642968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.643250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.644345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:22.645165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:22.647346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:22.648613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6456a-6d8f-4e80-ab5b-116b8dba9d02 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:22.671710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 437/866] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Jul 28 06:20:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:22.677508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:22.691794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:22.692554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.692895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.693237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.693996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:22.695445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:22.719716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 430/867] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:22 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:20:22.808114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e6cd5-4eba-482e-b7cf-057a50c262e1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:22.852548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:22.853247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:22.853526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:22.853799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:22.885110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:22.926697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:22.928187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.031362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 438/868] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:22 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 06:20:23.036866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.072159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:23.147425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b89e5-dfcb-4dea-8a3d-a1208bd3832a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.183893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1739ee4-7fc5-4faa-849f-dbe728146585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.184921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1739ee4-7fc5-4faa-849f-dbe728146585 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.185676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1739ee4-7fc5-4faa-849f-dbe728146585 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.186165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1739ee4-7fc5-4faa-849f-dbe728146585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.198016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1739ee4-7fc5-4faa-849f-dbe728146585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.199788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1739ee4-7fc5-4faa-849f-dbe728146585 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-f1739ee4-7fc5-4faa-849f-dbe728146585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:23.214890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:23.215887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:23.216771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:23.216771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:23.216771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:23.216771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:23.219058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 431/869] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:23.226789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.266415 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d56f-86d8-4d93-b432-462030a8c7cc None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.266732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d56f-86d8-4d93-b432-462030a8c7cc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.266972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d56f-86d8-4d93-b432-462030a8c7cc None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.268610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 432/870] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:23.273695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8d088-17cb-4d04-8704-cce479bbbd1d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.273982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8d088-17cb-4d04-8704-cce479bbbd1d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.274261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8d088-17cb-4d04-8704-cce479bbbd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.294058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-49a8d088-17cb-4d04-8704-cce479bbbd1d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:23.295338 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:23.295533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-49a8d088-17cb-4d04-8704-cce479bbbd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:23.334292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003e54-0a26-4ce5-ab3b-3c6654bf8124 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.371638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.372369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.372718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.373060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.373936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:23.374414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.375820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.383524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 433/871] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:23.395651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 439/872] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:23.396861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8d088-17cb-4d04-8704-cce479bbbd1d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.405492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.413239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:23.509798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8d088-17cb-4d04-8704-cce479bbbd1d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.535682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc500d-c1b0-4d76-9626-44f2ecec744a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.546595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.547505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.548004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.548468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.557843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.559483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:23.560789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.576082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:23.576726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:23.577612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:23.578519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:23.579876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.580344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.580784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.581702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.582693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 434/873] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:23.583538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.583680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:23.594553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:23.595750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:23.596627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:23.599857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 440/874] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:23.605492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.674714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:23.704337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f608d85-5bc8-4e11-8841-4287575b7767 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.711447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a695-85fc-4923-86e5-e431d9a50c8c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.739713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4153a0-4e6e-46bc-9cf8-2936a734709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.740441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4153a0-4e6e-46bc-9cf8-2936a734709a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.740834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4153a0-4e6e-46bc-9cf8-2936a734709a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.741208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4153a0-4e6e-46bc-9cf8-2936a734709a None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.741956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4153a0-4e6e-46bc-9cf8-2936a734709a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:23.742263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4153a0-4e6e-46bc-9cf8-2936a734709a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.744092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4153a0-4e6e-46bc-9cf8-2936a734709a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.746300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.747005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.747290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.747659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.748342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:23.748648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.749993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.759169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 435/875] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:23.760035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 441/876] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:23.760947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.761457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb894f2-056d-4503-8628-eedcdea3f1b9 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.761746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb894f2-056d-4503-8628-eedcdea3f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.762015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb894f2-056d-4503-8628-eedcdea3f1b9 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.763785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 436/877] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:23.768618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb894f2-056d-4503-8628-eedcdea3f1b9 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:23.819413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:23.874898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9788fa-121e-4908-a33b-91805894eb95 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.879859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb894f2-056d-4503-8628-eedcdea3f1b9 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:23.911564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890eee7-0d7c-45eb-ba6a-362f8b529cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.912233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890eee7-0d7c-45eb-ba6a-362f8b529cf7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.912511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890eee7-0d7c-45eb-ba6a-362f8b529cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.912795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890eee7-0d7c-45eb-ba6a-362f8b529cf7 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.913566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890eee7-0d7c-45eb-ba6a-362f8b529cf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:23.913872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890eee7-0d7c-45eb-ba6a-362f8b529cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.915250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890eee7-0d7c-45eb-ba6a-362f8b529cf7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.920031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 442/878] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:23.921256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa60b8b-2758-4a41-9883-1805c012d1b8 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.921569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa60b8b-2758-4a41-9883-1805c012d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.921814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa60b8b-2758-4a41-9883-1805c012d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.929838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:23.930771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:23.931232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:23.931717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:23.932709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=2cce71bab5154b19887ae23af182f2a7) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:23.933241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:23.934759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:23.937080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:23.944276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 437/879] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:23 2022] GET /identity/v3/role_assignments?user.id=2cce71bab5154b19887ae23af182f2a7&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:23.947175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ffa60b8b-2758-4a41-9883-1805c012d1b8 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:23.959738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ffa60b8b-2758-4a41-9883-1805c012d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:24.041105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 443/880] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:24.067209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:24.177165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170bfa3-1322-4688-a8a4-eacde1391b29 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:24.211963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93325169-0f1b-4457-a397-26de5c053690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:24.212936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325169-0f1b-4457-a397-26de5c053690 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:24.213217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325169-0f1b-4457-a397-26de5c053690 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:24.213484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325169-0f1b-4457-a397-26de5c053690 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:24.214176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93325169-0f1b-4457-a397-26de5c053690 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:24.215558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93325169-0f1b-4457-a397-26de5c053690 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:24.233635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 438/881] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:24 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:24.851258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394548-47f9-4637-b21d-ea4c4ddea30c None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:24.851817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394548-47f9-4637-b21d-ea4c4ddea30c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:24.851817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394548-47f9-4637-b21d-ea4c4ddea30c None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:24.853548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 444/882] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:24.858662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d4fe-ff34-45bf-bcbe-d9dfa7513523 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:24.859069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d4fe-ff34-45bf-bcbe-d9dfa7513523 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:24.859251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d4fe-ff34-45bf-bcbe-d9dfa7513523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:24.877892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cfe4d4fe-ff34-45bf-bcbe-d9dfa7513523 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:24.879064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cfe4d4fe-ff34-45bf-bcbe-d9dfa7513523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:24.932482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:24.955153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 439/883] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:24.977228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394548-47f9-4637-b21d-ea4c4ddea30c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:25.029230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:25.087760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394548-47f9-4637-b21d-ea4c4ddea30c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:25.124024 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:25.124623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:25.124904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:25.125177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:25.125832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:25.127254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:25.137436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:25.138480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:25.139490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 445/884] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:25.145063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d4fe-ff34-45bf-bcbe-d9dfa7513523 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:25.250900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d4fe-ff34-45bf-bcbe-d9dfa7513523 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:25.288778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:25.289811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:25.290287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:25.290745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:25.291593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:25.292100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:25.293648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:25.299180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 440/885] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:25.304792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:25.413491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43799a-3128-4cbd-8124-f7f8e99cebc4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:25.420499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:25.447739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:25.448553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:25.448893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:25.449497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:25.450176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:25.450479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:25.451866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:25.457300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 446/886] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:25.463382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:25.513369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:25.568678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6256ed-4359-4b26-83c5-7b4a1d8e9e41 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:25.604297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e3489-18b6-42d7-812c-c62349d011bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:25.605264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3489-18b6-42d7-812c-c62349d011bf None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:25.605727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3489-18b6-42d7-812c-c62349d011bf None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:25.606186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3489-18b6-42d7-812c-c62349d011bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:25.607114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e3489-18b6-42d7-812c-c62349d011bf None admin] RBAC: Adding query filter params (interface=public, service_id=7b83c1cd243b4b03953fbd30c8408fd8, region_id=RegionOne) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:25.607602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e3489-18b6-42d7-812c-c62349d011bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:25.609195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e3489-18b6-42d7-812c-c62349d011bf None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:25.617311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 441/887] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:20:25 2022] GET /identity/v3/endpoints?service_id=7b83c1cd243b4b03953fbd30c8408fd8&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:25.622566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:25.724611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a569fc-24ae-4b52-9056-32282bc4ef1b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:25.759189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bf7b4-12a3-42a2-92e9-8405c19e187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:25.759856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bf7b4-12a3-42a2-92e9-8405c19e187e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:25.760134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bf7b4-12a3-42a2-92e9-8405c19e187e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:25.760409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bf7b4-12a3-42a2-92e9-8405c19e187e None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:25.761061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bf7b4-12a3-42a2-92e9-8405c19e187e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:25.762425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bf7b4-12a3-42a2-92e9-8405c19e187e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:25.768605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 447/888] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:25 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:26.052089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b8893-99e0-4271-9638-03679fbf2dc1 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.053085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b8893-99e0-4271-9638-03679fbf2dc1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.053595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b8893-99e0-4271-9638-03679fbf2dc1 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.055411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 442/889] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:26.060931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e952f-fde7-431b-a1ef-266676c1c45f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.061724 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e952f-fde7-431b-a1ef-266676c1c45f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.062199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e952f-fde7-431b-a1ef-266676c1c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.081566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e74e952f-fde7-431b-a1ef-266676c1c45f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:26.083133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e74e952f-fde7-431b-a1ef-266676c1c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:26.111359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:26.155344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 448/890] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:26.178134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b8893-99e0-4271-9638-03679fbf2dc1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.192737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e725-2d3c-42a1-8560-6f5b07879534 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.193108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e725-2d3c-42a1-8560-6f5b07879534 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.193395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e725-2d3c-42a1-8560-6f5b07879534 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.195848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 449/891] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:26.202998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c7ad-fa0f-48ea-827e-f90b2c782d97 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.203381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c7ad-fa0f-48ea-827e-f90b2c782d97 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.203701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c7ad-fa0f-48ea-827e-f90b2c782d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.227225 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-48c8c7ad-fa0f-48ea-827e-f90b2c782d97 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:26.229087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-48c8c7ad-fa0f-48ea-827e-f90b2c782d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:26.296418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b8893-99e0-4271-9638-03679fbf2dc1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:26.311892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:26.312185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 450/892] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:26.313757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933dfbe-bd98-4f85-af86-8e283679e6b0 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.314181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933dfbe-bd98-4f85-af86-8e283679e6b0 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.314492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933dfbe-bd98-4f85-af86-8e283679e6b0 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.319906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 451/893] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:26.320976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8e8a-02cb-4f38-9240-ae75b6f65d4d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.321263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8e8a-02cb-4f38-9240-ae75b6f65d4d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.321902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8e8a-02cb-4f38-9240-ae75b6f65d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.342769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-387c8e8a-02cb-4f38-9240-ae75b6f65d4d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:26.344006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-387c8e8a-02cb-4f38-9240-ae75b6f65d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:26.346345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:26.346972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.347431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.347878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.348593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:26.349951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:26.367613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 443/894] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:26 2022] POST /identity/v3/services => generated 241 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:26.369106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.433873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 452/895] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:26.447110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8e8a-02cb-4f38-9240-ae75b6f65d4d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.470378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:26.534831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3590c1-0e3b-4e17-9c68-5fc0c8e3a4d7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:26.575469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8e8a-02cb-4f38-9240-ae75b6f65d4d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:26.587291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:26.588399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.588596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.588889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.605021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:26.611447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:26.612392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:26.613521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 444/896] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Jul 28 06:20:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:26.617381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:26.618045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.618320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.618588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.619222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:26.620553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.620683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:26.629914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:26.630877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:26.631899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 453/897] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Jul 28 06:20:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:26.637318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.664116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:26.735302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:26.754661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc3789-136e-4eff-80f4-8dad0637ddf9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:26.765910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a978a-b0e2-43ef-b9dc-f200a92f324c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:26.794403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:26.795104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.795386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.795774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.796452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:26.796847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:26.798289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:26.808492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 454/898] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:26.808857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:26.809367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.809631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.810014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.810292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.811014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:26.811320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:26.813796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:26.824731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 445/899] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Jul 28 06:20:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:26.830124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.922724 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4602dc-c95b-433d-bd94-6bcb3cb2e0b1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:26.945735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:26.953385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2c1b6-f000-49d2-9e18-11ed3b4b7f17 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:26.974382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:26.976074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.976563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.977316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:26.978458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:26.979377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:26.981530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:26.989324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 455/900] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:26.994709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:26.995044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:26.995732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:26.996016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:26.996288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.010331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:27.012762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:27.014870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:27.037212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:27.038349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:27.039542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:27.039542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:27.039542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:27.039542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:27.046409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 446/901] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:27.046679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:27.126338 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48692ab-7e4e-4ea2-90f5-683fca882350 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:27.152224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de5e83-23c1-4fda-9c6e-5e17ccdbfd63 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:27.173189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:27.174497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.175318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.175774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.176910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] RBAC: Adding query filter params (interface=public, service_id=491886d0da9d460fa33b17acf6a8e626, region_id=RegionOne) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:27.177768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:27.179866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:27.187225 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 456/902] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:20:26 2022] GET /identity/v3/endpoints?service_id=491886d0da9d460fa33b17acf6a8e626&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:27.192474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:27.192979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:27.193631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.193913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.194186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.194977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:27.195281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:27.197173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:27.215227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 447/903] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:27.216314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:27.226233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:27.284663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:27.309063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15e967-7cf9-47d2-a611-1693deac64a1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:27.345978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008df2-3871-4171-8fa4-09bc25678f6a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:27.346861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:27.348029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.348496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.349788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.350650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:27.352199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:27.360499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 457/904] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:27 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:27.400079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:27.400667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.400943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.401211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.409806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:27.411283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:27.424662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:27.425840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:27.426826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 448/905] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:20:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:27.434791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:27.548976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebc1f2-3f73-48ee-83c4-a4ab594fe30d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:27.587524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b76c4-49b6-4af0-b60f-ce682298515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:27.588582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b76c4-49b6-4af0-b60f-ce682298515e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.589088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b76c4-49b6-4af0-b60f-ce682298515e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.589574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b76c4-49b6-4af0-b60f-ce682298515e None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.590595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b76c4-49b6-4af0-b60f-ce682298515e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:27.591156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b76c4-49b6-4af0-b60f-ce682298515e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:27.592909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b76c4-49b6-4af0-b60f-ce682298515e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:27.612679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 458/906] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Jul 28 06:20:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:27.612994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:27.619132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:27.685949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:27.722634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c2c3-c54a-4d95-a6bf-d517f8a78bd7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:27.758179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:27.758938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.759226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.759502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.810160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560d66-1baa-4f51-902a-800d1c5251f4 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.810481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560d66-1baa-4f51-902a-800d1c5251f4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.810727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560d66-1baa-4f51-902a-800d1c5251f4 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.812372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 459/907] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:27.817433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74925-274f-412b-a51a-e850d6dcaf33 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:27.817670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74925-274f-412b-a51a-e850d6dcaf33 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:27.817944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74925-274f-412b-a51a-e850d6dcaf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:27.834348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:27.836256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:27.836974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-90e74925-274f-412b-a51a-e850d6dcaf33 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:27.838170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-90e74925-274f-412b-a51a-e850d6dcaf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:27.901884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:27.909813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 460/908] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:27.932476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74925-274f-412b-a51a-e850d6dcaf33 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:27.939099 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 449/909] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:27.944484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.062828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74925-274f-412b-a51a-e850d6dcaf33 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.081967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9634-d865-4a01-94b6-f56256c5d778 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.098543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:28.107453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.108154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.108436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.108710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.109342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.110732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:28.120256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:28.121266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 06:20:28.122090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:28.126704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 461/910] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:28.127568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.130839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.131864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.132393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.132884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.144104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.145826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:28.161490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:28.163018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:28.164410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:28.164410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:28.164410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:28.164410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:28.166378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 450/911] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:28.171664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.191728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:28.238094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652fb10-f67f-4a05-b192-b2680dd7bac6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.274780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d7526-e0b8-4749-aaa5-8f5fe33a31d3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.274996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.275440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.275748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.276033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.276704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:28.277014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.279162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.288418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 462/912] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:28.289274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.311153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.312132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.312622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.313084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.314064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:28.314571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.316202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.329245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 451/913] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:28.334656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.356541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:28.412508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284927-9a3b-4a73-aca1-e82f18fbaf0b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.438893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:28.454629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.455292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.455649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.456166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.456994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:28.457379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.459292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.470236 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 463/914] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:28.470779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab3fc-dd44-4556-b10c-5027a2bacedc None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.472528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.506333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f185de-3819-429b-b66d-1fc6c9589f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.506992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f185de-3819-429b-b66d-1fc6c9589f79 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.507276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f185de-3819-429b-b66d-1fc6c9589f79 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.507552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f185de-3819-429b-b66d-1fc6c9589f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.515074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f185de-3819-429b-b66d-1fc6c9589f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.516592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f185de-3819-429b-b66d-1fc6c9589f79 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b2f185de-3819-429b-b66d-1fc6c9589f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:28.528939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:28.529953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 452/915] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:28.531758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339c48-1811-4ac8-aeab-0ce8a7006225 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.532330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339c48-1811-4ac8-aeab-0ce8a7006225 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.532330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339c48-1811-4ac8-aeab-0ce8a7006225 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.533554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 453/916] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:28.538310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339c48-1811-4ac8-aeab-0ce8a7006225 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.588622 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d42742-0c7c-4451-ba5b-e275e9cf75e9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.612481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:28.628501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9d759-0745-4247-ab71-c3bb06091efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.629130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9d759-0745-4247-ab71-c3bb06091efc None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.629400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9d759-0745-4247-ab71-c3bb06091efc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.629690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9d759-0745-4247-ab71-c3bb06091efc None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.630394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9d759-0745-4247-ab71-c3bb06091efc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.631853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9d759-0745-4247-ab71-c3bb06091efc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.648321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339c48-1811-4ac8-aeab-0ce8a7006225 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.660725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 464/917] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:28.660725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e926b5-9576-48bb-9749-7cceba8f9298 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.660725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e926b5-9576-48bb-9749-7cceba8f9298 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.660725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e926b5-9576-48bb-9749-7cceba8f9298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.678828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f2e926b5-9576-48bb-9749-7cceba8f9298 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:28.680399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f2e926b5-9576-48bb-9749-7cceba8f9298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:28.711821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be2699-74ce-423c-a246-336660cd715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.713960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2699-74ce-423c-a246-336660cd715a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.714668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2699-74ce-423c-a246-336660cd715a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.715224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2699-74ce-423c-a246-336660cd715a None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.716576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be2699-74ce-423c-a246-336660cd715a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:28.717079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be2699-74ce-423c-a246-336660cd715a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.719650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be2699-74ce-423c-a246-336660cd715a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.722101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:28.737613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 454/918] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:28.743276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be2699-74ce-423c-a246-336660cd715a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.771642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 465/919] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:28.793151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e926b5-9576-48bb-9749-7cceba8f9298 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:28.889007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be2699-74ce-423c-a246-336660cd715a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.912019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e926b5-9576-48bb-9749-7cceba8f9298 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:28.919722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:28.931330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.932305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.932730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.933171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.934101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] RBAC: Adding query filter params (role.id=4e678d3dc8524903b6c5f7d9853242eb, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=2cce71bab5154b19887ae23af182f2a7) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:28.934783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.936255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.942428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 455/920] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/role_assignments?user.id=2cce71bab5154b19887ae23af182f2a7&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=4e678d3dc8524903b6c5f7d9853242eb => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:28.950203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:28.951231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:28.951738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:28.952262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:28.953095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:28.954734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:28.965699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:28.966748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:28.967579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:28.970859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 466/921] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:28.976987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:29.067405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:29.115546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80f23-25a7-4a77-be38-a82a06261f4b None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:29.151067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:29.151730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.152014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.152292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.152975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:29.153280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:29.154660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:29.159842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 456/922] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:29.165200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:29.270210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38884cc-3adb-44ba-b7fa-7c5db08abd6a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:29.304448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5442e-bf3c-4aaa-86e3-5c58b49bfeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:29.305085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5442e-bf3c-4aaa-86e3-5c58b49bfeb3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.305359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5442e-bf3c-4aaa-86e3-5c58b49bfeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.305628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5442e-bf3c-4aaa-86e3-5c58b49bfeb3 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.306309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5442e-bf3c-4aaa-86e3-5c58b49bfeb3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:29.306612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5442e-bf3c-4aaa-86e3-5c58b49bfeb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:29.307995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5442e-bf3c-4aaa-86e3-5c58b49bfeb3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:29.313328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 467/923] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:29.319203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:29.419649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caeabc-0b09-4f74-b59b-c9a6beb8af0f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.419988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caeabc-0b09-4f74-b59b-c9a6beb8af0f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.420207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caeabc-0b09-4f74-b59b-c9a6beb8af0f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.421943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 468/924] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:29.428047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee50180-5ccb-416b-afe9-9f76eeb66395 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.428047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee50180-5ccb-416b-afe9-9f76eeb66395 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.428047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee50180-5ccb-416b-afe9-9f76eeb66395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.429112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0689b-7b5d-489e-a379-ec828826b863 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:29.445810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3ee50180-5ccb-416b-afe9-9f76eeb66395 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:29.447364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3ee50180-5ccb-416b-afe9-9f76eeb66395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:29.470281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:29.471231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.471801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.472297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:29.472798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.473789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] RBAC: Adding query filter params (interface=public, service_id=4728976a3127495ca371152f2e360343, region_id=RegionOne) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:29.474485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:29.476842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:29.479385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:29.484061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 457/925] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:20:29 2022] GET /identity/v3/endpoints?service_id=4728976a3127495ca371152f2e360343&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:29.490800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:29.533090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 469/926] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:29.554478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee50180-5ccb-416b-afe9-9f76eeb66395 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:29.601435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b67172-afdd-462e-ade9-328914210b17 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:29.637147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:29.638316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.638790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.639254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.640160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:29.641721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:29.648556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 458/927] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:29 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:29.677590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee50180-5ccb-416b-afe9-9f76eeb66395 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:29.715480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:29.716631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.717108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.717576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.718430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:29.720136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:29.730574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:29.731661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 06:20:29.732499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:29.735539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 470/928] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Jul 28 06:20:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:29.742591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:29.799726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:29.856053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106df872-8a68-4301-bbc3-2aee14e806a4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:29.891054 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:29.891718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:29.891995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:29.892269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:29.892946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:29.893247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:29.894625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:29.901838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 459/929] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:29.907753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:29.938168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:30.019361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5dbdd-f168-4cd4-a984-708b4609c61d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:30.065564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec14a5-4253-4838-9b4c-dc998e02d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:30.066114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec14a5-4253-4838-9b4c-dc998e02d258 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.066394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec14a5-4253-4838-9b4c-dc998e02d258 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.066664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec14a5-4253-4838-9b4c-dc998e02d258 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:30.067335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec14a5-4253-4838-9b4c-dc998e02d258 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:30.067652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec14a5-4253-4838-9b4c-dc998e02d258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:30.069051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec14a5-4253-4838-9b4c-dc998e02d258 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:30.075022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 471/930] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:30.080923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:30.187183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2499a5-f94e-4998-a2eb-a3ed51d6949e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:30.201960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:30.224554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7801e1-2741-4903-9997-490b0815c728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:30.225504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7801e1-2741-4903-9997-490b0815c728 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.225923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7801e1-2741-4903-9997-490b0815c728 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.226369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7801e1-2741-4903-9997-490b0815c728 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:30.227229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7801e1-2741-4903-9997-490b0815c728 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:30.228770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7801e1-2741-4903-9997-490b0815c728 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:30.252354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 460/931] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:30.805267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865587c-e802-4d70-b92d-8031f06052a9 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.805832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865587c-e802-4d70-b92d-8031f06052a9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.805832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865587c-e802-4d70-b92d-8031f06052a9 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:30.807436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 472/932] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:30.812615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2a3a-18d9-414c-892e-c71608e2bed3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.813425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2a3a-18d9-414c-892e-c71608e2bed3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.813915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2a3a-18d9-414c-892e-c71608e2bed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:30.835490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7c2f2a3a-18d9-414c-892e-c71608e2bed3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:30.837101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7c2f2a3a-18d9-414c-892e-c71608e2bed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:30.913072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 461/933] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:30.935568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865587c-e802-4d70-b92d-8031f06052a9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:30.986082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4c51-260f-4d5a-8346-b587620a6cdc None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.986646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4c51-260f-4d5a-8346-b587620a6cdc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.987120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4c51-260f-4d5a-8346-b587620a6cdc None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:30.988967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 462/934] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:30.994203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17275bc-f636-4575-938d-6c439e900162 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.994594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17275bc-f636-4575-938d-6c439e900162 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.994934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17275bc-f636-4575-938d-6c439e900162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.016011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d17275bc-f636-4575-938d-6c439e900162 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:31.017320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d17275bc-f636-4575-938d-6c439e900162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:31.035143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:31.047035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865587c-e802-4d70-b92d-8031f06052a9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:31.082080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:31.082634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.082918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.083191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.083917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:31.085521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:31.087942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 463/935] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:31.089828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING keystone.server.flask.common [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 06:20:31.110169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17275bc-f636-4575-938d-6c439e900162 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.112716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.sql.core [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 06:20:31.112716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 06:20:31.112716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [parameters: {'id': 'be18650b64914ef79723dd19ce5dc05e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 06:20:31.112716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89166) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be18650b64914ef79723dd19ce5dc05e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be18650b64914ef79723dd19ce5dc05e. Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application conn.query(q) Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 06:20:31.120656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result.read() Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 06:20:31.121541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application next(self.gen) Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application yield resource Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application next(self.gen) Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise self.value Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application session.commit() Jul 28 06:20:31.122530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.session.flush() Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application compat.raise_( Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 06:20:31.123448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 06:20:31.124399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application conn.query(q) Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result.read() Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 06:20:31.125445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [parameters: {'id': 'be18650b64914ef79723dd19ce5dc05e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:31.126319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:31.127105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be18650b64914ef79723dd19ce5dc05e. Jul 28 06:20:31.128071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.130560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 473/936] 10.222.0.58 () {60 vars in 1140 bytes} [Thu Jul 28 06:20:30 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:31.139442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.141408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:31.217678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17275bc-f636-4575-938d-6c439e900162 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:31.262371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab4b68-47cd-4617-b29f-fd51a93c773c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:31.266812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:31.267598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.268005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.268376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.282810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:31.290135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:31.291145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:31.292032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:31.292909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 464/937] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:31.298890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.299027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:31.299733 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.300149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.300507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.307742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:31.309476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:31.321710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:31.322826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:31.324668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 474/938] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:31.331347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.343523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:31.414511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:31.433823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475030ba-32a9-4850-85a4-97d4835c9a02 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:31.467899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d9c7-59c7-4314-be28-ec337096c13d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:31.481190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:31.482313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.483144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.483761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.484773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:31.485412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:31.487256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:31.499013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 465/939] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:31.504648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.505539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:31.506463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.506971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.507720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.509637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:31.510156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:31.511831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:31.547891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 475/940] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:31.622582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca4218-c0f3-4907-9c7c-09e0d45f5522 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:31.659341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3dc8-1ea4-4b0f-b699-58b13ab63f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:31.660050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3dc8-1ea4-4b0f-b699-58b13ab63f86 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.660632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3dc8-1ea4-4b0f-b699-58b13ab63f86 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.661088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3dc8-1ea4-4b0f-b699-58b13ab63f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.674064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3dc8-1ea4-4b0f-b699-58b13ab63f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:31.675543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3dc8-1ea4-4b0f-b699-58b13ab63f86 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:31.684575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3f6d3dc8-1ea4-4b0f-b699-58b13ab63f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:31.692405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:31.693709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:31.694922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:31.694922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:31.694922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:31.694922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:31.700051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 466/941] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:31.702481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.737906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d459-8b11-43d3-8033-c53b9f8e3b8a None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.738178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d459-8b11-43d3-8033-c53b9f8e3b8a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.738454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d459-8b11-43d3-8033-c53b9f8e3b8a None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.740236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 467/942] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:31.745682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9182e0-213f-4d63-9d18-19fa7b387fec None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.745936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9182e0-213f-4d63-9d18-19fa7b387fec None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.746232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9182e0-213f-4d63-9d18-19fa7b387fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.774229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-fd9182e0-213f-4d63-9d18-19fa7b387fec None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:31.775441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-fd9182e0-213f-4d63-9d18-19fa7b387fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:31.794865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:31.837346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab6777-84af-48a4-b5b5-629ce04556af None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:31.864513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 468/943] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:31.880792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:31.881414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:31.881694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:31.881965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:31.882659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:31.882960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:31.884461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:31.886492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9182e0-213f-4d63-9d18-19fa7b387fec None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.897350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 476/944] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:31.903538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:31.989586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9182e0-213f-4d63-9d18-19fa7b387fec None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.020191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.030930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.031769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7cc66-7327-4e3c-9541-6ac6219de10a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.032011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.032439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.032895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.033669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.035207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:32.045764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:32.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:32.047808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:32.055091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 469/945] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:32.056229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.064011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.074185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.074856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.075138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.075544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.086373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.088974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:32.102484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:32.103835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:32.105023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:32.106235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 477/946] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:20:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:32.111715 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.188231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655aa89-11fd-4584-b3db-5632120113e2 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.222275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40ad94-9967-406b-aa2a-27c320812033 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.235487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.236592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.237557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.238245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.239078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:32.239789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.241749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.253035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 470/947] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:32.254015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.262662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.264091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.264522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.264964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.265939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:32.266881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.269307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.294209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 478/948] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:32.299651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.324024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.357222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.368739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425879-3557-4430-9f84-5776ce2faf73 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.404448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11706534-0fa3-4814-a8fc-628b0fdd2e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.405076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11706534-0fa3-4814-a8fc-628b0fdd2e0d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.405353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11706534-0fa3-4814-a8fc-628b0fdd2e0d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.405624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11706534-0fa3-4814-a8fc-628b0fdd2e0d None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.406297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11706534-0fa3-4814-a8fc-628b0fdd2e0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:32.406596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11706534-0fa3-4814-a8fc-628b0fdd2e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.408034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11706534-0fa3-4814-a8fc-628b0fdd2e0d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.417667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 471/949] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:32.417667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2dcb1-c00d-4baf-a27a-a5734327d023 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.417667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2dcb1-c00d-4baf-a27a-a5734327d023 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.417667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2dcb1-c00d-4baf-a27a-a5734327d023 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.417667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 472/950] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:32.418583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2dcb1-c00d-4baf-a27a-a5734327d023 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.422957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468af6-723f-46f2-bbb1-71750423921a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.459394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ecc69-00f2-4f1b-ac21-e9e7976f2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.460117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ecc69-00f2-4f1b-ac21-e9e7976f2a59 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.460403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ecc69-00f2-4f1b-ac21-e9e7976f2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.460683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ecc69-00f2-4f1b-ac21-e9e7976f2a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.471403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ecc69-00f2-4f1b-ac21-e9e7976f2a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.472885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ecc69-00f2-4f1b-ac21-e9e7976f2a59 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-888ecc69-00f2-4f1b-ac21-e9e7976f2a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:32.488087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:32.488992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:32.489915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:32.489915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:32.489915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:32.489915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:32.494265 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 479/951] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:32.495657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd29ea-e6b6-4bc3-84a0-15f9def289a1 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.495933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd29ea-e6b6-4bc3-84a0-15f9def289a1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.496210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd29ea-e6b6-4bc3-84a0-15f9def289a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.514673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-b2cd29ea-e6b6-4bc3-84a0-15f9def289a1 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:32.516369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b2cd29ea-e6b6-4bc3-84a0-15f9def289a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:32.525726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2dcb1-c00d-4baf-a27a-a5734327d023 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.550273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.563654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.564342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.564623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.564901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.565767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.567285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.591680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 480/952] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:32.591680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd29ea-e6b6-4bc3-84a0-15f9def289a1 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.599478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 473/953] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:20:32.609484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.626832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.716235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd29ea-e6b6-4bc3-84a0-15f9def289a1 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.735063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4a706-4cf2-43e5-8b38-651ea5db03de None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.758518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.760176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.760601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.761034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.761894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:32.762309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.763713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.773561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.774463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.774902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.775328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.776142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.776713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 481/954] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:32.777971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.782910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:32.789331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:32.790467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:32.791383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 474/955] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:32.798180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.849663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.907430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa412a16-036a-439a-ace6-010fb90612a2 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.913187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758943f-bc2b-4c5a-ad09-b89d4225cd6f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.948725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.949148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:32.949347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.949627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.949940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.951087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] RBAC: Adding query filter params (name=compute) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:32.951279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.952770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.954896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.955654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.956411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.956966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.958104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 475/956] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:32.963874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.965673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.969049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:32.984988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:32.986064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:32.986988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:32.994822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 482/957] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:32.995929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:33.092442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbecd77-b3c0-4e56-b48e-058798091511 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:33.094266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:33.113486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08636b31-8278-4b08-8f1c-3e008f9d1cee None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:33.130355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:33.131253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:33.131735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:33.132156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:33.132991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:33.133454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:33.134979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:33.145711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 476/958] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:33.149284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfee89-555e-4a23-83b2-e4bb4919592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:33.150275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfee89-555e-4a23-83b2-e4bb4919592d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:33.150789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfee89-555e-4a23-83b2-e4bb4919592d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:33.151271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfee89-555e-4a23-83b2-e4bb4919592d None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:33.152299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfee89-555e-4a23-83b2-e4bb4919592d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:33.152824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfee89-555e-4a23-83b2-e4bb4919592d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:33.154536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfee89-555e-4a23-83b2-e4bb4919592d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:33.170019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 483/959] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:33.177134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:33.292396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9b89-5e9d-4ac2-bc21-bc9900088165 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:33.329612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73813c96-eb2c-41b7-bf91-097a2536db02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:33.330308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73813c96-eb2c-41b7-bf91-097a2536db02 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:33.330586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73813c96-eb2c-41b7-bf91-097a2536db02 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:33.330863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73813c96-eb2c-41b7-bf91-097a2536db02 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/2cce71bab5154b19887ae23af182f2a7/roles/4e678d3dc8524903b6c5f7d9853242eb` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:33.333129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73813c96-eb2c-41b7-bf91-097a2536db02 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=2cce71bab5154b19887ae23af182f2a7, role_id=4e678d3dc8524903b6c5f7d9853242eb)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:33.334635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73813c96-eb2c-41b7-bf91-097a2536db02 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:33.352344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 477/960] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:20:33 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/2cce71bab5154b19887ae23af182f2a7/roles/4e678d3dc8524903b6c5f7d9853242eb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:33.739658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216621cf-455b-4051-9bb8-6d6cd8d2fa3f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:33.740046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216621cf-455b-4051-9bb8-6d6cd8d2fa3f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:33.740241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216621cf-455b-4051-9bb8-6d6cd8d2fa3f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:33.742038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 484/961] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:33.747461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35035f53-ae22-442b-8607-b065c2a8659a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:33.747781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35035f53-ae22-442b-8607-b065c2a8659a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:33.751334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35035f53-ae22-442b-8607-b065c2a8659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:33.767541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-35035f53-ae22-442b-8607-b065c2a8659a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:33.769277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-35035f53-ae22-442b-8607-b065c2a8659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:33.793529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:33.849456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 478/962] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:33.873716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216621cf-455b-4051-9bb8-6d6cd8d2fa3f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:33.884976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:33.976502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216621cf-455b-4051-9bb8-6d6cd8d2fa3f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:34.010057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:34.010662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:34.010945 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:34.011218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:34.011978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:34.013409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:34.034796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.sql.core [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 06:20:34.034796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 06:20:34.034796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [parameters: {'user_id': '53c4aeeb6de84a31b0cefc9048d65143', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 06:20:34.034796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89166) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application conn.query(q) Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result.read() Jul 28 06:20:34.042097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 06:20:34.043011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application next(self.gen) Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application yield resource Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application next(self.gen) Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise self.value Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application session.commit() Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 06:20:34.044651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.session.flush() Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application compat.raise_( Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 06:20:34.045809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 06:20:34.047110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application conn.query(q) Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application result.read() Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 06:20:34.051979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [parameters: {'user_id': '53c4aeeb6de84a31b0cefc9048d65143', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:34.052822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 06:20:34.053787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 06:20:34.054927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 06:20:34.054927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 06:20:34.054927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 06:20:34.054927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 06:20:34.054927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 06:20:34.054927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:34.054927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 485/963] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Jul 28 06:20:33 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:34.056790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35035f53-ae22-442b-8607-b065c2a8659a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:34.164872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35035f53-ae22-442b-8607-b065c2a8659a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:34.201375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7fb39-3b4c-4642-b973-8169d96a6117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:34.202347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fb39-3b4c-4642-b973-8169d96a6117 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:34.202829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fb39-3b4c-4642-b973-8169d96a6117 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:34.203298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fb39-3b4c-4642-b973-8169d96a6117 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:34.211047 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7fb39-3b4c-4642-b973-8169d96a6117 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:34.212975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7fb39-3b4c-4642-b973-8169d96a6117 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-47f7fb39-3b4c-4642-b973-8169d96a6117 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:34.225720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:34.226658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 06:20:34.227599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:34.230285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 479/964] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:34.236050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:34.315408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:34.350842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07110c7a-8e54-4347-9f9b-f872544c30a5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:34.386425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3747c-deae-461c-8a08-8c75f84fda13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:34.387356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3747c-deae-461c-8a08-8c75f84fda13 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:34.387891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3747c-deae-461c-8a08-8c75f84fda13 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:34.388372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3747c-deae-461c-8a08-8c75f84fda13 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:34.389312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3747c-deae-461c-8a08-8c75f84fda13 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:34.389808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3747c-deae-461c-8a08-8c75f84fda13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:34.391649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3747c-deae-461c-8a08-8c75f84fda13 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:34.431263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 486/965] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Jul 28 06:20:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:34.732805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c29f-fb1c-4d37-9caf-1dd40541a700 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:34.733105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c29f-fb1c-4d37-9caf-1dd40541a700 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:34.733366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c29f-fb1c-4d37-9caf-1dd40541a700 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:34.734741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 480/966] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:34.740223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03229-e66f-4b50-bfcf-49827a57b6f3 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:34.740605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03229-e66f-4b50-bfcf-49827a57b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:34.740884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03229-e66f-4b50-bfcf-49827a57b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:34.761176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-bac03229-e66f-4b50-bfcf-49827a57b6f3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:34.763046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bac03229-e66f-4b50-bfcf-49827a57b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:34.835114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 487/967] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:34.857199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8c29f-fb1c-4d37-9caf-1dd40541a700 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:34.876701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:34.964434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8c29f-fb1c-4d37-9caf-1dd40541a700 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:34.998627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:34.999183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:34.999464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:34.999768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.000391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:35.001759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:35.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:35.011738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:35.012590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:35.013951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 481/968] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:35.017936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03229-e66f-4b50-bfcf-49827a57b6f3 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:35.086995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.131668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03229-e66f-4b50-bfcf-49827a57b6f3 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:35.167561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647db4-0009-451b-a784-6c753a77b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:35.168490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647db4-0009-451b-a784-6c753a77b38c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.168942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647db4-0009-451b-a784-6c753a77b38c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.169361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647db4-0009-451b-a784-6c753a77b38c None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.170205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a647db4-0009-451b-a784-6c753a77b38c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:35.170653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a647db4-0009-451b-a784-6c753a77b38c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:35.172219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a647db4-0009-451b-a784-6c753a77b38c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:35.178402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 488/969] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:35.183895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:35.212677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a85e-5638-4891-804b-a1b3dbf6f1f9 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.213085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a85e-5638-4891-804b-a1b3dbf6f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.213360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a85e-5638-4891-804b-a1b3dbf6f1f9 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.214888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 489/970] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:35.219717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612863e-968f-4296-a039-c42c21bc216f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.220008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612863e-968f-4296-a039-c42c21bc216f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.220283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612863e-968f-4296-a039-c42c21bc216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.239012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-c612863e-968f-4296-a039-c42c21bc216f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:35.240249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c612863e-968f-4296-a039-c42c21bc216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:35.269221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.293177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d7d5-475b-4185-af9a-79f4e74e4524 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:35.312584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 490/971] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:35.331839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:35.332471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.332751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.333021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.333691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:35.334359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:35.335366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612863e-968f-4296-a039-c42c21bc216f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:35.335481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:35.346317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 482/972] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:35.347876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:35.392237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.440350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612863e-968f-4296-a039-c42c21bc216f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:35.447715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43339fe-a822-4e7f-902f-e21b2ee96135 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:35.476098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:35.476732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.477031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.477307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.478001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:35.479377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:35.481942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71442-7f33-4c5f-8eec-43b815203712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:35.482559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71442-7f33-4c5f-8eec-43b815203712 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.482837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71442-7f33-4c5f-8eec-43b815203712 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.483109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71442-7f33-4c5f-8eec-43b815203712 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.483895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f71442-7f33-4c5f-8eec-43b815203712 None admin] RBAC: Adding query filter params (interface=admin, service_id=4728976a3127495ca371152f2e360343, region_id=RegionOne) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:35.484206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f71442-7f33-4c5f-8eec-43b815203712 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:35.485580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f71442-7f33-4c5f-8eec-43b815203712 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:35.493604 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 483/973] 10.222.0.58 () {56 vars in 1249 bytes} [Thu Jul 28 06:20:35 2022] GET /identity/v3/endpoints?service_id=4728976a3127495ca371152f2e360343&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:35.495586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8490d-5f4c-4fcc-9606-fc983dbeda90 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.496072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8490d-5f4c-4fcc-9606-fc983dbeda90 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.496540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8490d-5f4c-4fcc-9606-fc983dbeda90 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.497947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 491/974] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:35 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:35.500219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 484/975] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:35.502127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:35.505823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bc554-3300-4ad1-bd02-6230df89a548 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.506154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bc554-3300-4ad1-bd02-6230df89a548 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.506666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bc554-3300-4ad1-bd02-6230df89a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.525677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-513bc554-3300-4ad1-bd02-6230df89a548 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:35.526813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-513bc554-3300-4ad1-bd02-6230df89a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:35.529084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.635644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 485/976] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:35.641761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04866f0-cb17-424a-81a9-73cc3a37ee6b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:35.648676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bc554-3300-4ad1-bd02-6230df89a548 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:35.657721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.684219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:35.684855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.685136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.685415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.686074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:35.687453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:35.694816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 492/977] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:35 2022] GET /identity/v3/services => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:35.766798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bc554-3300-4ad1-bd02-6230df89a548 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:35.807846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:35.808432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.808711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.808983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.811360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.823314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:35.828388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:35.829382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:35.830242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 486/978] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Jul 28 06:20:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:35.837326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:35.946813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff572e-3f5b-49d6-9404-6777343725aa None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:35.981384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:35.982015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:35.982294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:35.982573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:35.983278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:35.983582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:35.984978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:35.993493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 493/979] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Jul 28 06:20:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:35.999239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:36.115998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059c3c1-18c4-4d53-8044-3a969d3870b8 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:36.151041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:36.151705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:36.151984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:36.152254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:36.162786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:36.164260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:36.180147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:36.181177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:36.182082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:36.182082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:36.182082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:36.182082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:36.182082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 487/980] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:36.187153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:36.231085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:36.294197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fef46f-bd64-420f-8bc2-b7af6ca4c1d3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:36.328104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:36.328732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:36.329009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:36.329286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:36.329970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:36.330272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:36.331652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:36.347710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 494/981] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:36.349007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:36.397506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:36.454948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19458125-ac4f-4478-9dc4-b1af97fb7ce7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:36.488139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:36.488779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:36.489056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:36.489323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:36.496875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:36.498303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:36.509436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:36.510386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 06:20:36.511423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:36.515448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 488/982] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:20:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:36.516340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:36.614199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:36.618544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aac8d-604c-44f9-940f-fbefcfca2935 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:36.655106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:36.655698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:36.655970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:36.656239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:36.657052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:36.657362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:36.658833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:36.682886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 495/983] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Jul 28 06:20:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:36.684672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:36.794528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace6a2-79e3-46bc-925f-27b92d71afa1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:36.802978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:36.831761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:36.832406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:36.832687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:36.832961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:36.902610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:36.904126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.007032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 489/984] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:36 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:37.008759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.118114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c79431-5ade-4070-9d00-cfda5a4e08d9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:37.152300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:37.152956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.153239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.153508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.164350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:37.165813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:37.180574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:37.181488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:37.182380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:37.182380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:37.182380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:37.182380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:37.186478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 496/985] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:37.187959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.196952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:37.292657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291441-d538-4a1e-855b-0241a0982909 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:37.328665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:37.329297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.329582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.329853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.330543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:37.330849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:37.332274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.343966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 490/986] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:37.349605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.361320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:37.452040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877dc4-3c5d-49f1-9c90-6d1f22c0ff22 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:37.487524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bbb02-d504-46fe-9b83-150984a6b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:37.489214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bbb02-d504-46fe-9b83-150984a6b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.489214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bbb02-d504-46fe-9b83-150984a6b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.489214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bbb02-d504-46fe-9b83-150984a6b2f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.497048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bbb02-d504-46fe-9b83-150984a6b2f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:37.498538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bbb02-d504-46fe-9b83-150984a6b2f8 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-845bbb02-d504-46fe-9b83-150984a6b2f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:37.512272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:37.513196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:37.514082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:37.515732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 497/987] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:37.519649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.541229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6eb3-0456-4b2a-82c4-f4f60bbbc5a1 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.541514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6eb3-0456-4b2a-82c4-f4f60bbbc5a1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.541787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6eb3-0456-4b2a-82c4-f4f60bbbc5a1 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.543221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 498/988] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:37.547946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608bf6e-584b-454d-8f4d-14a03d6b1e5f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.548256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608bf6e-584b-454d-8f4d-14a03d6b1e5f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.548506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608bf6e-584b-454d-8f4d-14a03d6b1e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.567099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5608bf6e-584b-454d-8f4d-14a03d6b1e5f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:37.568304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5608bf6e-584b-454d-8f4d-14a03d6b1e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:37.597880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:37.634069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a794ce-fbab-4900-a7a8-55bd437c8873 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:37.634578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:37.642963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 499/989] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:37.664863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608bf6e-584b-454d-8f4d-14a03d6b1e5f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.669273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:37.669904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.670184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.670458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.671208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:37.671516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:37.673202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.686112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 491/990] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:37.692157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.768636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608bf6e-584b-454d-8f4d-14a03d6b1e5f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:37.796520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e6ce3-925a-47c9-8782-dc6d88136bce None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:37.808190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d193f-7857-4325-9dc1-968b6860f38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:37.808859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d193f-7857-4325-9dc1-968b6860f38f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.809139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d193f-7857-4325-9dc1-968b6860f38f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.809412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d193f-7857-4325-9dc1-968b6860f38f None admin] PATH_INFO: `/v3/services/compute` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.810043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d193f-7857-4325-9dc1-968b6860f38f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:37.811418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d193f-7857-4325-9dc1-968b6860f38f None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-421d193f-7857-4325-9dc1-968b6860f38f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:37.820440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:37.821850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:37.822713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:37.825663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:37.826975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 500/991] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:37.828380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5139b28-ba83-499f-934e-6fcd929450b9 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.829735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5139b28-ba83-499f-934e-6fcd929450b9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.829735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5139b28-ba83-499f-934e-6fcd929450b9 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.830201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 501/992] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:37.830969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5139b28-ba83-499f-934e-6fcd929450b9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.837173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c77d1-1bfa-4934-8ab7-ee89b3b6578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:37.837809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c77d1-1bfa-4934-8ab7-ee89b3b6578f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.838090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c77d1-1bfa-4934-8ab7-ee89b3b6578f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.838369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c77d1-1bfa-4934-8ab7-ee89b3b6578f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.839160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c77d1-1bfa-4934-8ab7-ee89b3b6578f None admin] RBAC: Adding query filter params (role.id=4e678d3dc8524903b6c5f7d9853242eb, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=2cce71bab5154b19887ae23af182f2a7) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:37.839469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c77d1-1bfa-4934-8ab7-ee89b3b6578f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:37.841409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c77d1-1bfa-4934-8ab7-ee89b3b6578f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.848529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 492/993] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/role_assignments?user.id=2cce71bab5154b19887ae23af182f2a7&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=4e678d3dc8524903b6c5f7d9853242eb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:37.849764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9dc7-b8d3-4bb7-bc60-64cccfc55784 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.850052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9dc7-b8d3-4bb7-bc60-64cccfc55784 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.850318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9dc7-b8d3-4bb7-bc60-64cccfc55784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.870334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1cee9dc7-b8d3-4bb7-bc60-64cccfc55784 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:37.871597 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1cee9dc7-b8d3-4bb7-bc60-64cccfc55784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:37.901854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:37.949464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 493/994] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:37.950537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5139b28-ba83-499f-934e-6fcd929450b9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:37.972554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee9dc7-b8d3-4bb7-bc60-64cccfc55784 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:37.989030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:37.989656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:37.989903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:37.990204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:37.990995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:37.991369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:37.992996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:37.999684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 502/995] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:38.004943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:38.088725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee9dc7-b8d3-4bb7-bc60-64cccfc55784 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.109762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:38.122782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ab845-522b-4ff4-8382-3eeb0da085a6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.126314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.126974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.127256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.127532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.128198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.129584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:38.138873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:38.139931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:38.140784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 494/996] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Jul 28 06:20:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:38.146315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:38.154270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:38.165667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.166421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.166706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.166984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.167696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:38.168008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.169516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.180233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 503/997] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:38.180889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:38.253261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecea1f-3070-409e-a391-9579fabf10e0 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.286845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815885fb-6632-4b80-80d6-ca53a484f650 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.288805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.289509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.289786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.290063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.290745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:38.291048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.292463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.297515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 495/998] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:38.303171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:38.327239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.327905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.328189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.328465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.329218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] RBAC: Adding query filter params (interface=public, service_id=8b14285e980d488291e9d6a1f9f1f7cf, region_id=RegionOne) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:38.329524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.330893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.341887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 504/999] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:20:38 2022] GET /identity/v3/endpoints?service_id=8b14285e980d488291e9d6a1f9f1f7cf&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:38.344330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:38.359830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:38.405525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:38.415581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd6218-502c-4152-a208-29fd8409ff61 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.451910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.452542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.452819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.453092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.453763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:38.454069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.455352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd870b9-b6e6-4bbb-b791-4b4ed2f127b5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.455456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.466061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 496/1000] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Jul 28 06:20:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:38.467007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:38.498794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae64c6-1871-4f82-8371-239f4edb3d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.499426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae64c6-1871-4f82-8371-239f4edb3d5d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.499756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae64c6-1871-4f82-8371-239f4edb3d5d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.500292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae64c6-1871-4f82-8371-239f4edb3d5d None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.500659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae64c6-1871-4f82-8371-239f4edb3d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.502022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae64c6-1871-4f82-8371-239f4edb3d5d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.508708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 505/1001] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:38 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:38.578272 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c39e-c97f-4c92-a39f-7adf8e898be0 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.594091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:38.618910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a990031-c35c-434e-8c00-1eca04d807ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.619561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a990031-c35c-434e-8c00-1eca04d807ad None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.619866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a990031-c35c-434e-8c00-1eca04d807ad None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.620142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a990031-c35c-434e-8c00-1eca04d807ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.620863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a990031-c35c-434e-8c00-1eca04d807ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.622260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a990031-c35c-434e-8c00-1eca04d807ad None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.647659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 497/1002] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:39.853437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e370-9fff-4602-9296-30b3be19a716 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:39.854031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e370-9fff-4602-9296-30b3be19a716 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:39.854031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e370-9fff-4602-9296-30b3be19a716 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:39.855535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 506/1003] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:39.860552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6ed3-b2d2-4fca-9702-c4de3a13d03e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:39.860963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6ed3-b2d2-4fca-9702-c4de3a13d03e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:39.861084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6ed3-b2d2-4fca-9702-c4de3a13d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:39.879393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-c00e6ed3-b2d2-4fca-9702-c4de3a13d03e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:39.880602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c00e6ed3-b2d2-4fca-9702-c4de3a13d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:39.956056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 498/1004] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:39.977291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8e370-9fff-4602-9296-30b3be19a716 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:40.087657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8e370-9fff-4602-9296-30b3be19a716 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:40.105648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:40.123499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:40.124184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.124464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.124734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] PATH_INFO: `/v3/services/image` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.125352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:40.126725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:40.135842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:40.136852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:40.137704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:40.139956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 507/1005] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Jul 28 06:20:39 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:40.142908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6ed3-b2d2-4fca-9702-c4de3a13d03e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:40.248097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:40.252957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6ed3-b2d2-4fca-9702-c4de3a13d03e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:40.290674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea58d4-3f66-40a4-8d5a-f4895f4b3e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:40.291311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea58d4-3f66-40a4-8d5a-f4895f4b3e56 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.291592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea58d4-3f66-40a4-8d5a-f4895f4b3e56 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.291897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea58d4-3f66-40a4-8d5a-f4895f4b3e56 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.292568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea58d4-3f66-40a4-8d5a-f4895f4b3e56 None admin] RBAC: Adding query filter params (name=image) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:40.292871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea58d4-3f66-40a4-8d5a-f4895f4b3e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:40.294243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea58d4-3f66-40a4-8d5a-f4895f4b3e56 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:40.299345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 499/1006] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:40.305052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:40.406877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850fea-41d0-4962-a18c-508abf02618b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:40.441769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae73a5-f593-46f8-bdca-002b123c0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:40.442397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae73a5-f593-46f8-bdca-002b123c0165 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.442674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae73a5-f593-46f8-bdca-002b123c0165 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.442945 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae73a5-f593-46f8-bdca-002b123c0165 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.443692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae73a5-f593-46f8-bdca-002b123c0165 None admin] RBAC: Adding query filter params (type=image) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:40.443996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae73a5-f593-46f8-bdca-002b123c0165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:40.445371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae73a5-f593-46f8-bdca-002b123c0165 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:40.450518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 508/1007] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:40.538650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586258a-f0c3-4c20-8ca3-775912420785 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.538936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586258a-f0c3-4c20-8ca3-775912420785 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.539377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586258a-f0c3-4c20-8ca3-775912420785 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.540902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 500/1008] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:40.546939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dffec-0b5d-41c7-b041-b82c6ec2eb4d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.547237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dffec-0b5d-41c7-b041-b82c6ec2eb4d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.547497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dffec-0b5d-41c7-b041-b82c6ec2eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.567261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1c0dffec-0b5d-41c7-b041-b82c6ec2eb4d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:40.568538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1c0dffec-0b5d-41c7-b041-b82c6ec2eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:40.620505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:40.638447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c7c5c-170d-43a3-984a-2339508c17c3 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.638823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c7c5c-170d-43a3-984a-2339508c17c3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.639174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c7c5c-170d-43a3-984a-2339508c17c3 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.640976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 501/1009] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:40.646231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be261f26-e1f6-479c-aa23-a1c4dd296585 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.646556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be261f26-e1f6-479c-aa23-a1c4dd296585 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.646831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be261f26-e1f6-479c-aa23-a1c4dd296585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.647674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 509/1010] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:40.664877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-be261f26-e1f6-479c-aa23-a1c4dd296585 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:40.665979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-be261f26-e1f6-479c-aa23-a1c4dd296585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:40.670060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dffec-0b5d-41c7-b041-b82c6ec2eb4d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:40.738986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 502/1011] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:40.762351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be261f26-e1f6-479c-aa23-a1c4dd296585 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:40.784494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dffec-0b5d-41c7-b041-b82c6ec2eb4d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:40.820256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:40.820919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.821609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.821925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.822585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:40.823952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:40.834863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:40.835938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:40.836785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 510/1012] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:40.842078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:40.864246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:40.875331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be261f26-e1f6-479c-aa23-a1c4dd296585 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:40.886494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:40.914175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:40.914844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.915178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.915398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.917301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:40.918747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:40.920612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 503/1013] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:40.926292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:40.952056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb50e4c-db2f-4619-a5bc-514b1a88ca81 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:40.987830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:40.988456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:40.988798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:40.989003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:40.989671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:40.989970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:40.991366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:40.996508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 511/1014] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:41.002532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:41.034307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85286129-6b70-46b4-a69b-86cccbf0fbbb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:41.070303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:41.070936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:41.071582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:41.071881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:41.072558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:41.074012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:41.102841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 504/1015] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:40 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:20:41.122483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0082-0db2-4cf9-92a0-4a2d4499f3cb None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:41.126251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:41.164151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0931-4f17-4228-8e23-824f04160ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:41.164816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0931-4f17-4228-8e23-824f04160ed0 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:41.165095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0931-4f17-4228-8e23-824f04160ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:41.165421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0931-4f17-4228-8e23-824f04160ed0 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:41.166057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0931-4f17-4228-8e23-824f04160ed0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:41.166360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0931-4f17-4228-8e23-824f04160ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:41.167857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0931-4f17-4228-8e23-824f04160ed0 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:41.174230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 512/1016] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Jul 28 06:20:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:41.180090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:41.198740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:41.296201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d18329-92a1-4f75-8ce6-e7f0f6cd9287 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:41.330025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1ded8-ef2f-4184-890f-a409da5ea708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:41.330651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1ded8-ef2f-4184-890f-a409da5ea708 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:41.330928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1ded8-ef2f-4184-890f-a409da5ea708 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:41.331239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1ded8-ef2f-4184-890f-a409da5ea708 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:41.331965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1ded8-ef2f-4184-890f-a409da5ea708 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:41.333337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1ded8-ef2f-4184-890f-a409da5ea708 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:41.356048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 505/1017] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:42.443688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525e69-1bf4-4f6c-bb7d-dd73a3718a47 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:42.444210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525e69-1bf4-4f6c-bb7d-dd73a3718a47 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:42.444210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525e69-1bf4-4f6c-bb7d-dd73a3718a47 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:42.447094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 513/1018] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:42.451608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86608-4f19-49a8-8ea8-856fe09bacf0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:42.452082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86608-4f19-49a8-8ea8-856fe09bacf0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:42.452172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86608-4f19-49a8-8ea8-856fe09bacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:42.471076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-62c86608-4f19-49a8-8ea8-856fe09bacf0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:42.472345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-62c86608-4f19-49a8-8ea8-856fe09bacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:42.537448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:42.550815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 506/1019] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:42.573625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525e69-1bf4-4f6c-bb7d-dd73a3718a47 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:42.681234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525e69-1bf4-4f6c-bb7d-dd73a3718a47 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:42.715411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d235e-cc9b-4e83-9333-42671f52ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:42.716067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d235e-cc9b-4e83-9333-42671f52ee21 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:42.716360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d235e-cc9b-4e83-9333-42671f52ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:42.716621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d235e-cc9b-4e83-9333-42671f52ee21 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:42.717303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d235e-cc9b-4e83-9333-42671f52ee21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:42.718665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d235e-cc9b-4e83-9333-42671f52ee21 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:42.743649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 514/1020] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:20:42 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:43.153179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719f3b-8283-46ef-9080-60a465682d84 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.153520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719f3b-8283-46ef-9080-60a465682d84 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.153738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719f3b-8283-46ef-9080-60a465682d84 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.155203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 507/1021] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:43.160591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35905927-9d81-4b7b-9b3a-b0758b515755 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.160966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35905927-9d81-4b7b-9b3a-b0758b515755 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.161308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35905927-9d81-4b7b-9b3a-b0758b515755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.180153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-35905927-9d81-4b7b-9b3a-b0758b515755 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:43.181362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-35905927-9d81-4b7b-9b3a-b0758b515755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:43.208227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:43.262258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 515/1022] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:43.286168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c719f3b-8283-46ef-9080-60a465682d84 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:43.392286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c719f3b-8283-46ef-9080-60a465682d84 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:43.426288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f989a-d1f6-4f74-85a2-71fe29dc483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:43.426934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f989a-d1f6-4f74-85a2-71fe29dc483e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.427219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f989a-d1f6-4f74-85a2-71fe29dc483e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.427475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f989a-d1f6-4f74-85a2-71fe29dc483e None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.428693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f989a-d1f6-4f74-85a2-71fe29dc483e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:43.430132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f989a-d1f6-4f74-85a2-71fe29dc483e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:43.431963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 508/1023] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:43.437718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35905927-9d81-4b7b-9b3a-b0758b515755 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:43.438255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae798d7e-7c2b-4798-b54c-c91ed867b308 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.438546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae798d7e-7c2b-4798-b54c-c91ed867b308 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.438825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae798d7e-7c2b-4798-b54c-c91ed867b308 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.440314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 509/1024] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:43.445428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7733240-4012-43d6-96cb-7637b0979c0f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.445718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7733240-4012-43d6-96cb-7637b0979c0f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.445993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7733240-4012-43d6-96cb-7637b0979c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.464840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f7733240-4012-43d6-96cb-7637b0979c0f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:43.466057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f7733240-4012-43d6-96cb-7637b0979c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:43.529069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:43.541169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 510/1025] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:43.546395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35905927-9d81-4b7b-9b3a-b0758b515755 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:43.564515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7733240-4012-43d6-96cb-7637b0979c0f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:43.582227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:43.582867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.583151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.583431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.584231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:43.585679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:43.610974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 516/1026] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:20:43 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:43.675544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7733240-4012-43d6-96cb-7637b0979c0f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:43.715347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:43.716301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.716726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.717143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.729307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:43.734535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:43.735560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:43.736486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 511/1027] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Jul 28 06:20:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:43.742825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:43.757158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:43.854266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896fbd7-5166-4ef6-948e-c0b490ed2b15 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:43.891518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:43.892276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:43.892564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:43.892843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:43.893574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:43.893874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:43.895414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:43.907755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 517/1028] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Jul 28 06:20:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:43.910206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:43.967149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:44.016320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe73b8c-fb80-4d95-906c-bd458a0f6ff2 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:44.056221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:44.056872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:44.057206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:44.057770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:44.068261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:44.069887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:44.085128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:44.086012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:44.086923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:44.086923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:44.086923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:44.086923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:44.086923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 512/1029] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:44.093080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:44.168821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:44.202662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb9fdb-a145-4ce4-822f-cda78947e295 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:44.238086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:44.238717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:44.238999 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:44.239273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:44.240003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:44.240375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:44.241751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:44.255017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 518/1030] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:44.260564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:44.365768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd676f-24fb-40ed-a4cc-575840061b8d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:44.368235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:44.402586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:44.403373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:44.403664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:44.403952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] PATH_INFO: `/v3/users/nova` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:44.413986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:44.415448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:44.427398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:44.428615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:44.429986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:44.430861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 513/1031] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:20:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:44.434412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:44.543029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d057f9-f1b8-4856-b5aa-06bb5745d411 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:44.572412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:44.579344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987af4c-66d3-4924-a89d-db5c9d4988d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:44.580002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987af4c-66d3-4924-a89d-db5c9d4988d7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:44.580285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987af4c-66d3-4924-a89d-db5c9d4988d7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:44.580654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987af4c-66d3-4924-a89d-db5c9d4988d7 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:44.581455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987af4c-66d3-4924-a89d-db5c9d4988d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:44.581759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987af4c-66d3-4924-a89d-db5c9d4988d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:44.583184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987af4c-66d3-4924-a89d-db5c9d4988d7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:44.600875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 519/1032] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:20:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:44.606446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:44.709885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a4fc8-9148-4470-9505-c497448d607e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:44.735114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38724de5-0171-4204-bf57-636aeed53d66 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:44.735434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38724de5-0171-4204-bf57-636aeed53d66 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:44.735710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38724de5-0171-4204-bf57-636aeed53d66 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:44.737215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 520/1033] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:44.742288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d787-b2e5-49f0-a403-3e9f61918cb4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:44.742573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d787-b2e5-49f0-a403-3e9f61918cb4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:44.742847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d787-b2e5-49f0-a403-3e9f61918cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:44.744726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:44.745391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:44.745630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:44.746041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:44.762136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3731d787-b2e5-49f0-a403-3e9f61918cb4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:44.763320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3731d787-b2e5-49f0-a403-3e9f61918cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:44.780005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:44.822845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:44.824354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:44.855787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 521/1034] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:44.868947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731d787-b2e5-49f0-a403-3e9f61918cb4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:44.928661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 514/1035] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:44.934331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:44.973294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731d787-b2e5-49f0-a403-3e9f61918cb4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:44.994427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:44.998564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.011656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.012405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.012690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.012965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] PATH_INFO: `/v3/services/image` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.013588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.015057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:45.025923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:45.027296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:45.028385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 522/1036] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Jul 28 06:20:44 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:45.031927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.055118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f618a-55d2-46ab-9f8f-48e72658d316 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.090520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.091172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.091453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.091772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.103385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.104969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:45.123055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:45.124086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:45.125511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:45.125511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:45.125511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:45.125511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:45.125511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 515/1037] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:45.130479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.136171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac953cb1-32d1-49a1-9086-e49ebf53469a None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.181213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.181842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.182119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.182397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.183066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] RBAC: Adding query filter params (name=image) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:45.183374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.184774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.190119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 523/1038] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:45.195577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.241514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924ff91-66b8-4b6c-8177-9b59c04d96c7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.252930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.260242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.283309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.284016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.284298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.284574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.285263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:45.285568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.286997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.298960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 516/1039] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:45.304546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.308440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac308a84-146c-4ec6-bf4a-a4fefd03dda5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.343216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.343953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.344237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.344509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.345191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] RBAC: Adding query filter params (type=image) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:45.345486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.347252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.357707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 524/1040] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:45.359140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.408314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18aa3-28ab-4813-affd-a9bb9fbb4250 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.444552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.445204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.445483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.445757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.453344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.454971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.459175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a0887-9bbd-4d66-ab39-67e5ab02d0e4 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:45.466651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:45.467557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:45.468502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 517/1041] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:45.473585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.474750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.498291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.498842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.499123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.499399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.500182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] RBAC: Adding query filter params (interface=public, service_id=44841f9503da43e7b5cb06b50f1a9f9c, region_id=RegionOne) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:45.500493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.501840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.506941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 525/1042] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/endpoints?service_id=44841f9503da43e7b5cb06b50f1a9f9c&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:45.512398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.512679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.583937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401960f-fc03-47e1-9b17-d46424e4bae3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.617775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d679-29b5-47f7-b2b6-52348372baba None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.622630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.623265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.623536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.623842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.624584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:45.624891 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.626328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.638891 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 518/1043] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:45.644790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.652916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f8527-0a48-49fe-af03-97423c8e8e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.653590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f8527-0a48-49fe-af03-97423c8e8e52 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.653868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f8527-0a48-49fe-af03-97423c8e8e52 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.654138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f8527-0a48-49fe-af03-97423c8e8e52 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.654786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f8527-0a48-49fe-af03-97423c8e8e52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.656175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f8527-0a48-49fe-af03-97423c8e8e52 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.663664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 526/1044] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:20:45.669745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbaa77-4eca-41a5-8f31-66b7e881b796 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.670037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbaa77-4eca-41a5-8f31-66b7e881b796 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.670293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbaa77-4eca-41a5-8f31-66b7e881b796 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.671885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 527/1045] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:45.677518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc749e-0fb8-46c2-85d3-380eedf827b6 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.677832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc749e-0fb8-46c2-85d3-380eedf827b6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.678068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc749e-0fb8-46c2-85d3-380eedf827b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.698150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-13dc749e-0fb8-46c2-85d3-380eedf827b6 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:45.699457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-13dc749e-0fb8-46c2-85d3-380eedf827b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:45.738631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.762565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.771051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d41f-5de5-47f9-afb0-63f156bae715 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.780297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 528/1046] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:45.803324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc749e-0fb8-46c2-85d3-380eedf827b6 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.819490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.820158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.820804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.820804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.821867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] RBAC: Adding query filter params (role.id=4e678d3dc8524903b6c5f7d9853242eb, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=f1b5bd02365348098c1e7b448a996f12) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:45.822174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.823643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.829377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 519/1047] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/role_assignments?user.id=f1b5bd02365348098c1e7b448a996f12&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=4e678d3dc8524903b6c5f7d9853242eb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:45.925416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc749e-0fb8-46c2-85d3-380eedf827b6 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.963996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.964665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.964934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.965208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.977217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:45.982202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:45.983130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:45.984026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 529/1048] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:45.989550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:46.102285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ad79-35b8-4e42-b412-79cf778fea2d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:46.141509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:46.142146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:46.142421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:46.142695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:46.143410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:46.143740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:46.145118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:46.159008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 520/1049] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:46.160184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:46.192729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:46.264151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a6f1-e5d8-4b58-80b4-8a65b4be043f None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:46.298953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:46.299527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:46.299833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:46.300107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] PATH_INFO: `/v3/users/acbdb508650d43c7bc1f566a7ae230a2` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:46.313905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] RBAC: Authorizing `identity:get_user(user_id=acbdb508650d43c7bc1f566a7ae230a2)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:46.315342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:46.317234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 530/1050] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:20:46 2022] GET /identity/v3/users/acbdb508650d43c7bc1f566a7ae230a2 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:46.323403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:46.348579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:46.427391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbdb33-ad95-4ecb-8189-4e29876bf606 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:46.462433 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:46.463053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:46.463339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:46.463610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:46.533681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:46.535146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:46.558266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:46.635581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 521/1051] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:46.641437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:46.730376 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:46.743783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a939f-00f6-44ea-9c74-4fc8280350e9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:46.779498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb775-e516-463b-b89b-8c3dfb6faaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:46.780218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb775-e516-463b-b89b-8c3dfb6faaa8 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:46.780498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb775-e516-463b-b89b-8c3dfb6faaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:46.780775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb775-e516-463b-b89b-8c3dfb6faaa8 None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:46.781983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb775-e516-463b-b89b-8c3dfb6faaa8 None admin] RBAC: Authorizing `identity:get_project(project_id=2774562febce429ba0e164c4a93c99e1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:46.783427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb775-e516-463b-b89b-8c3dfb6faaa8 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:46.785176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 531/1052] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:20:46 2022] GET /identity/v3/projects/2774562febce429ba0e164c4a93c99e1 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:46.791648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:46.899257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de9659-999d-48f3-abb6-bdd028933932 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:46.924593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:46.937862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a7ca6-6fea-43d9-aff0-f1c2ca100ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:46.938488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7ca6-6fea-43d9-aff0-f1c2ca100ae2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:46.938771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7ca6-6fea-43d9-aff0-f1c2ca100ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:46.939073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7ca6-6fea-43d9-aff0-f1c2ca100ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:46.939890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a7ca6-6fea-43d9-aff0-f1c2ca100ae2 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=2774562febce429ba0e164c4a93c99e1, user.id=acbdb508650d43c7bc1f566a7ae230a2) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:46.940196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a7ca6-6fea-43d9-aff0-f1c2ca100ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:46.941640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a7ca6-6fea-43d9-aff0-f1c2ca100ae2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:46.947927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 522/1053] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:46 2022] GET /identity/v3/role_assignments?user.id=acbdb508650d43c7bc1f566a7ae230a2&scope.project.id=2774562febce429ba0e164c4a93c99e1&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:47.656720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ec47-4997-490b-b334-2bf63b908504 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:47.657268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ec47-4997-490b-b334-2bf63b908504 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:47.657268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ec47-4997-490b-b334-2bf63b908504 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:47.658589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 532/1054] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:47.664429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb3e35-d67a-4e46-9743-99d73d053aa0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:47.664895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb3e35-d67a-4e46-9743-99d73d053aa0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:47.664974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb3e35-d67a-4e46-9743-99d73d053aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:47.683189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a5fb3e35-d67a-4e46-9743-99d73d053aa0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:47.684408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a5fb3e35-d67a-4e46-9743-99d73d053aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:47.753776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 523/1055] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:47.775560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ec47-4997-490b-b334-2bf63b908504 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:47.796440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72044e4-7f33-44e2-866e-82ee98ce8df0 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:47.796725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72044e4-7f33-44e2-866e-82ee98ce8df0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:47.797003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72044e4-7f33-44e2-866e-82ee98ce8df0 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:47.798365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 524/1056] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:47.803800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb302a3-88a7-47b3-a003-db4ef6935bb7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:47.804121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb302a3-88a7-47b3-a003-db4ef6935bb7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:47.804406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb302a3-88a7-47b3-a003-db4ef6935bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:47.824890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6fb302a3-88a7-47b3-a003-db4ef6935bb7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:47.826150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6fb302a3-88a7-47b3-a003-db4ef6935bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:47.887396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ec47-4997-490b-b334-2bf63b908504 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:47.902357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 525/1057] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:20:47.922580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:47.923483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:47.923931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb302a3-88a7-47b3-a003-db4ef6935bb7 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:47.924177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:47.924629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] PATH_INFO: `/v3/services/image` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:47.925418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:47.926952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:47.936362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:47.937655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 06:20:47.938727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:47.942861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 533/1058] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Jul 28 06:20:47 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:47.944200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:47.967821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:47.977929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:48.041486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb302a3-88a7-47b3-a003-db4ef6935bb7 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.056625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6986-ddb6-4261-854c-5fc540e9d1d1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.077653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.078310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.078592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.078905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.089266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:48.093776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:48.094172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:48.095083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:48.096578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:48.097244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.097244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.097244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.097244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] RBAC: Adding query filter params (name=image) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:48.097244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.097861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:48.100459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 526/1059] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Jul 28 06:20:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:48.101308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:48.102794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 534/1060] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:48.108176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:48.193159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:48.204112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485908eb-6a1e-4dbb-ae94-160c10105512 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.211489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:48.212359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e452-b94e-439f-b1fb-28bcc9f71855 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.243640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.244239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.244514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.244787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.245494 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:48.245793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.247188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:48.252097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.252735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.253014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.253288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.253963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:48.254283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.260395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 527/1061] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Jul 28 06:20:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:48.260527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:48.260761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 535/1062] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:48.265805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:48.265916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:48.371686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61af3-3368-442c-a6a5-89d7a5dbd2c2 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.372084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2b46f-f14d-48bb-bd0e-65b4129fa967 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.404901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.405551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.405829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.406103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.407471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.408133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.408417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.408691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.409412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.410779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:48.417445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.418913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:48.433968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:48.434940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:48.436365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:48.436365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:48.436365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:48.436365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:48.440223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 528/1063] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:48.441268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:48.443934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 536/1064] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:48.467586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:48.556668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279168-3a5e-4f55-9725-15ab80cea8e9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.600347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.601008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.601288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.601567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.602249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:48.602830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.604238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:48.616534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 529/1065] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:48.622398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:48.626394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:48.730110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040aac-34df-4719-8b98-12710c2e7a92 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.767530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301461-7504-4fa7-ab98-377c79e89a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.768199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301461-7504-4fa7-ab98-377c79e89a49 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.768496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301461-7504-4fa7-ab98-377c79e89a49 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.768767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301461-7504-4fa7-ab98-377c79e89a49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.780118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b301461-7504-4fa7-ab98-377c79e89a49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.781582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b301461-7504-4fa7-ab98-377c79e89a49 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-9b301461-7504-4fa7-ab98-377c79e89a49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:48.796311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:48.797340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:48.798314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 537/1066] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:20:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:48.806212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:48.901686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:48.908278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b94a-23ae-4f6c-9d0c-26a505d75ee6 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.908565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b94a-23ae-4f6c-9d0c-26a505d75ee6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.908847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b94a-23ae-4f6c-9d0c-26a505d75ee6 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.914164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 538/1067] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:20:48.915360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318a77-3f9b-40d9-bd6f-fb17bfada2d2 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.916194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318a77-3f9b-40d9-bd6f-fb17bfada2d2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.916194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318a77-3f9b-40d9-bd6f-fb17bfada2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.931448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2b19-1e7d-4a2d-aab4-66f61b2db6d4 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:48.934369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-14318a77-3f9b-40d9-bd6f-fb17bfada2d2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:48.935574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-14318a77-3f9b-40d9-bd6f-fb17bfada2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:48.977536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:48.978179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:48.978460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:48.978726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:48.979529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:48.979856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:48.981359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.008497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 530/1068] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:20:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:49.014280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.016028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:49.028657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 539/1069] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:49.050124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14318a77-3f9b-40d9-bd6f-fb17bfada2d2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.163408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14318a77-3f9b-40d9-bd6f-fb17bfada2d2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.173806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f9856-8edd-4864-84a8-24afdd8384d9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.204778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.205458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.205743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.206016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.220054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:49.224659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:49.225049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:49.225961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:49.226858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:49.228769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.229492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.229959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.231344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 540/1070] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:49.232367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.234083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:49.249106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.250887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:49.268026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:49.269133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:49.270254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:49.270254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:49.270254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:49.270254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:49.270254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 531/1071] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:49.275064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.296457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:49.344484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343489f-55b5-460b-8710-85b99fc43d40 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.379284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.379950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.380232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.380565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.381282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:49.381585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.382959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.385798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658229af-0cd4-4999-bb1a-d4c3aa2c68ac None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.392000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 541/1072] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:49.397621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.421595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.422226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.422511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.422787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.423475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:49.423812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.425195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.442947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 532/1073] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:49.444319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.493026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:49.501412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd55163-d044-46dc-9f11-3f5773acfc96 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.519053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:49.540036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.540940 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.540940 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.541223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] PATH_INFO: `/v3/users/acbdb508650d43c7bc1f566a7ae230a2` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.542400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] RBAC: Authorizing `identity:get_user(user_id=acbdb508650d43c7bc1f566a7ae230a2)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.543859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.545487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 542/1074] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/users/acbdb508650d43c7bc1f566a7ae230a2 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:49.553449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.554648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3011e-eb8e-4cb1-b762-9a78a71da071 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.597779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.599083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.599909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.600376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.610879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.613192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:49.625813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:49.626727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:49.627606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 533/1075] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:49.633016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.664361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910820-8bc9-4f84-9132-2a2449ccc959 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.698698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.699335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.699637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.699912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.701088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] RBAC: Authorizing `identity:get_project(project_id=2774562febce429ba0e164c4a93c99e1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.702523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.704415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 543/1076] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/projects/2774562febce429ba0e164c4a93c99e1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:49.710123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.747916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de12dec-a21d-42cb-9139-1a60abb86fb5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.756140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:49.771389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:49.786669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.787310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.787596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.787899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.788657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:49.788966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.790394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.805139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 534/1077] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:49.810981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:49.826925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82914c3-a294-4c21-81ff-0a75ae77c67b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.863326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b339193-4d70-436a-b325-91083d6c4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.864045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339193-4d70-436a-b325-91083d6c4ef7 None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.864339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339193-4d70-436a-b325-91083d6c4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.864591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339193-4d70-436a-b325-91083d6c4ef7 None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1/users/acbdb508650d43c7bc1f566a7ae230a2/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.866599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b339193-4d70-436a-b325-91083d6c4ef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2774562febce429ba0e164c4a93c99e1, user_id=acbdb508650d43c7bc1f566a7ae230a2, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.868061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b339193-4d70-436a-b325-91083d6c4ef7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.881945 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 544/1078] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:20:49 2022] PUT /identity/v3/projects/2774562febce429ba0e164c4a93c99e1/users/acbdb508650d43c7bc1f566a7ae230a2/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:20:49.920170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa759482-bbfa-4df7-99a8-c6ef721e1334 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:49.958902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d0a20-b8b2-47d1-a8c2-d52a37f6e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:49.959599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d0a20-b8b2-47d1-a8c2-d52a37f6e820 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:49.959907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d0a20-b8b2-47d1-a8c2-d52a37f6e820 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:49.960186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d0a20-b8b2-47d1-a8c2-d52a37f6e820 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/f1b5bd02365348098c1e7b448a996f12/roles/4e678d3dc8524903b6c5f7d9853242eb` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:49.962477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d0a20-b8b2-47d1-a8c2-d52a37f6e820 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=f1b5bd02365348098c1e7b448a996f12, role_id=4e678d3dc8524903b6c5f7d9853242eb)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:49.963982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d0a20-b8b2-47d1-a8c2-d52a37f6e820 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:49.979102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 535/1079] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:20:49 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/f1b5bd02365348098c1e7b448a996f12/roles/4e678d3dc8524903b6c5f7d9853242eb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:20:50.487835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b423ee-43c8-40e5-94ce-ceebc3465a69 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:50.488248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b423ee-43c8-40e5-94ce-ceebc3465a69 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:50.488350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b423ee-43c8-40e5-94ce-ceebc3465a69 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:50.489992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 545/1080] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:50.495204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019096ad-a415-4725-96e1-bb0fe30c77a7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:50.495469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019096ad-a415-4725-96e1-bb0fe30c77a7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:50.495805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019096ad-a415-4725-96e1-bb0fe30c77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:50.514461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-019096ad-a415-4725-96e1-bb0fe30c77a7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:50.515697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-019096ad-a415-4725-96e1-bb0fe30c77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:50.538320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:50.587856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 536/1081] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:50.608913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b423ee-43c8-40e5-94ce-ceebc3465a69 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:50.714413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b423ee-43c8-40e5-94ce-ceebc3465a69 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:50.727312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:50.751531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:50.752129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:50.752410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:50.752681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:50.820530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:50.822353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:50.922787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 546/1082] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:50.928899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019096ad-a415-4725-96e1-bb0fe30c77a7 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:51.037835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019096ad-a415-4725-96e1-bb0fe30c77a7 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:51.075118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63973df-cd96-460d-b998-33c897ea30d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:51.075815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63973df-cd96-460d-b998-33c897ea30d2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:51.076102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63973df-cd96-460d-b998-33c897ea30d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:51.076373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63973df-cd96-460d-b998-33c897ea30d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:51.087717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63973df-cd96-460d-b998-33c897ea30d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:51.089178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63973df-cd96-460d-b998-33c897ea30d2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-a63973df-cd96-460d-b998-33c897ea30d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:51.104311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:51.105198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:51.106094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:51.106094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:51.106094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:51.106094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:51.107715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 537/1083] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:51.111652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:51.125778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:51.215842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cdf36-8da3-49b3-80df-7ef890e5eea1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:51.249779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005ccec-12cc-428c-819c-752910c39a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:51.250689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ccec-12cc-428c-819c-752910c39a16 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:51.251185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ccec-12cc-428c-819c-752910c39a16 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:51.251677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ccec-12cc-428c-819c-752910c39a16 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:51.252552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005ccec-12cc-428c-819c-752910c39a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:51.253047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005ccec-12cc-428c-819c-752910c39a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:51.254600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005ccec-12cc-428c-819c-752910c39a16 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:51.266303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 547/1084] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:51.879346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f4d9-f5c3-427c-9eaf-216e96fbc89b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:51.879631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f4d9-f5c3-427c-9eaf-216e96fbc89b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:51.879934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f4d9-f5c3-427c-9eaf-216e96fbc89b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:51.881338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 538/1085] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:51.886911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7422-7da5-40ae-b9ac-cb5c34dab44a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:51.887419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7422-7da5-40ae-b9ac-cb5c34dab44a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:51.887511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7422-7da5-40ae-b9ac-cb5c34dab44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:51.907192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-cdbe7422-7da5-40ae-b9ac-cb5c34dab44a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:51.908541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-cdbe7422-7da5-40ae-b9ac-cb5c34dab44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:51.949932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199444fa-efad-4d54-a94d-c6ad656a54a0 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:51.950479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199444fa-efad-4d54-a94d-c6ad656a54a0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:51.950479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199444fa-efad-4d54-a94d-c6ad656a54a0 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:51.951828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 539/1086] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:51.957291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f953ca-3996-428a-ae0e-f262eb04cfc9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:51.957696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f953ca-3996-428a-ae0e-f262eb04cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:51.958046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f953ca-3996-428a-ae0e-f262eb04cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:51.978429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-30f953ca-3996-428a-ae0e-f262eb04cfc9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:51.979644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-30f953ca-3996-428a-ae0e-f262eb04cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:51.980282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 548/1087] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:51.981875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.003652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7422-7da5-40ae-b9ac-cb5c34dab44a None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.005832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.049619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 540/1088] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:52.072587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f953ca-3996-428a-ae0e-f262eb04cfc9 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.110096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7422-7da5-40ae-b9ac-cb5c34dab44a None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.145662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.146528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.146802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.147074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.157755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:52.162779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:52.163820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:52.164706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 549/1089] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:20:52.169953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.171603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f953ca-3996-428a-ae0e-f262eb04cfc9 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.205374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.206014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.206298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.206571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.213406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.217386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:20:52.222418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:52.223439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:52.224380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 541/1090] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:52.229711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.234408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.275247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481cff-702d-4dc1-87b6-fb6bb8d3fbc2 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.314419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.315298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.315727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.316159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.317223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:52.317599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.319155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.328460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 550/1091] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:52.334446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.341770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea531b6-436c-4db1-ad1b-88f13d3af64c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.376925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.377584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.377871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.378170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.378890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:52.379196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.380733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.388831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 542/1092] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:52.394482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.433568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b749e-1f4f-4d9e-b5b9-70d9cd6b7989 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.452757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.457375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.468592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.469286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.469564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.469843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] PATH_INFO: `/v3/users/acbdb508650d43c7bc1f566a7ae230a2` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.471033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] RBAC: Authorizing `identity:get_user(user_id=acbdb508650d43c7bc1f566a7ae230a2)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.472506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.474373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 551/1093] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/users/acbdb508650d43c7bc1f566a7ae230a2 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:52.479921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.493761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743d9a-1408-406f-bd84-60cfc1d17f87 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.529379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.530022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.530295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.530563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.541240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.542689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:52.557174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:52.558174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:52.559246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:52.559246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:52.559246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:52.559246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:52.559246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 543/1094] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:52.564203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.578178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a46c0-5615-4929-852b-cbf07340bf49 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.612222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.612847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.613127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.613384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.663966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038448a0-0b45-47b4-b02f-f56b60b03eb3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.670903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.676993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.681281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.682740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.699706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.700276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.700554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.700822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.701497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:52.701793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.703168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.715084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 544/1095] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:52.721086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.781865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 552/1096] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:52.787834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.820377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248d22-ac42-4957-84b7-f745d7055564 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.854788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.855440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.855750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.856024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.863031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.864515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.875739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:20:52.876314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:52.877220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:20:52.878160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 545/1097] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:52.883869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.884803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be264-865b-4332-9ca7-d79196d00aff None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:52.914982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:52.921556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:52.922214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:52.922490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:52.922762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:52.923954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] RBAC: Authorizing `identity:get_project(project_id=2774562febce429ba0e164c4a93c99e1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:52.925387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:52.932281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 553/1098] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/projects/2774562febce429ba0e164c4a93c99e1 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:52.933584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:52.984590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12ed63-f72d-414f-ac8d-bda60a3c3c14 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:53.017680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:53.018296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:53.018573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:53.018844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:53.019700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:53.020006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:53.021486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:53.043471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 546/1099] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:20:53.043674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9f0a-33f0-4a48-8901-930897449636 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:53.044527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:53.074276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:53.074888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:53.075168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:53.075436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:53.076233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=2774562febce429ba0e164c4a93c99e1, user.id=acbdb508650d43c7bc1f566a7ae230a2) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:53.076534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:53.077959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:53.083609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 554/1100] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:52 2022] GET /identity/v3/role_assignments?user.id=acbdb508650d43c7bc1f566a7ae230a2&scope.project.id=2774562febce429ba0e164c4a93c99e1&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:53.139895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:53.151534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2ad50-8575-469d-a0bc-7ed0ed88a694 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:53.187968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:53.188613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:53.188897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:53.189177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:53.263313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:53.264754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:53.353135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:53.364814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 547/1101] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:53.370818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:53.398265 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:53.474894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72d4f4-cba0-4a52-985c-6c8da0d08d57 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:53.509592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:53.510238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:53.510510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:53.510779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:53.521837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:53.523233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:20:53.537614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:53.538608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:53.539747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:20:53.539747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:20:53.539747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:20:53.539747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:53.539747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 555/1102] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:53.544651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:53.652105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aa157-908a-471a-9318-e8b650ab7f11 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:53.684688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:53.685306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:53.685587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:53.685860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:53.686533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:53.686834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:53.688241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:53.700160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 548/1103] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:53.705754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:53.787611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:53.810886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe053a78-41ec-4f41-827d-61de96c43967 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:53.844310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:53.844950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:53.845230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:53.845502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:53.852243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:53.853677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:20:53.864995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:20:53.865904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:20:53.866793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 556/1104] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:20:53.872341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:53.929139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:53.987490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a127a73-544e-43a1-ac20-ba4d85b908b5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:54.023758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88a485-2cb5-48db-affc-b4f4d99aea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:54.024392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88a485-2cb5-48db-affc-b4f4d99aea71 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:54.024669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88a485-2cb5-48db-affc-b4f4d99aea71 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:54.024940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88a485-2cb5-48db-affc-b4f4d99aea71 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:54.025682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88a485-2cb5-48db-affc-b4f4d99aea71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:54.026017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88a485-2cb5-48db-affc-b4f4d99aea71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:54.027455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88a485-2cb5-48db-affc-b4f4d99aea71 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:54.040083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 549/1105] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:54.046199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:54.143002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72276a1-bf44-444a-9a60-33c2da4f6f56 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:54.175665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c2257-deee-415d-8322-19c0a8725ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:54.176308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c2257-deee-415d-8322-19c0a8725ad1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:54.176583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c2257-deee-415d-8322-19c0a8725ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:54.176854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c2257-deee-415d-8322-19c0a8725ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:54.177726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c2257-deee-415d-8322-19c0a8725ad1 None admin] RBAC: Adding query filter params (role.id=4e678d3dc8524903b6c5f7d9853242eb, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=f1b5bd02365348098c1e7b448a996f12) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:54.178031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c2257-deee-415d-8322-19c0a8725ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:54.179459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c2257-deee-415d-8322-19c0a8725ad1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:54.182420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:54.196325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 557/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:54 2022] GET /identity/v3/role_assignments?user.id=f1b5bd02365348098c1e7b448a996f12&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=4e678d3dc8524903b6c5f7d9853242eb => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:55.078038 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481f3a3-7a69-4178-90a2-15a9152dd8b5 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.078543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481f3a3-7a69-4178-90a2-15a9152dd8b5 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.078543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481f3a3-7a69-4178-90a2-15a9152dd8b5 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.079991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 550/1107] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:55.086251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9aa98-c252-45f7-a96c-34c7e677ebe1 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.086926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9aa98-c252-45f7-a96c-34c7e677ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.087042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9aa98-c252-45f7-a96c-34c7e677ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.110892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-b3f9aa98-c252-45f7-a96c-34c7e677ebe1 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:55.112222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b3f9aa98-c252-45f7-a96c-34c7e677ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:55.185554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 558/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:55.211053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481f3a3-7a69-4178-90a2-15a9152dd8b5 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.327497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481f3a3-7a69-4178-90a2-15a9152dd8b5 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.338802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:55.368444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca53ac-9387-4c19-ac81-54313e7be560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.369088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca53ac-9387-4c19-ac81-54313e7be560 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.369372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca53ac-9387-4c19-ac81-54313e7be560 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.369642 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca53ac-9387-4c19-ac81-54313e7be560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.370994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca53ac-9387-4c19-ac81-54313e7be560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.372498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca53ac-9387-4c19-ac81-54313e7be560 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.374106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 551/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:20:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:55.380529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9aa98-c252-45f7-a96c-34c7e677ebe1 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.492892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9aa98-c252-45f7-a96c-34c7e677ebe1 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.522329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:55.529492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0bef0-9cd7-408b-a975-bfda908abb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.530142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0bef0-9cd7-408b-a975-bfda908abb55 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.530409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0bef0-9cd7-408b-a975-bfda908abb55 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.530679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0bef0-9cd7-408b-a975-bfda908abb55 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.531361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0bef0-9cd7-408b-a975-bfda908abb55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.532838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0bef0-9cd7-408b-a975-bfda908abb55 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.556135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 559/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:20:55 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:57.574183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308501-af37-4549-8305-1ad7db50a083 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:57.575075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308501-af37-4549-8305-1ad7db50a083 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:57.575075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308501-af37-4549-8305-1ad7db50a083 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:57.577258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 552/1111] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:20:57.586079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f39c1-cee6-4bb9-851b-a2fb14c9bb5e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:57.586498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f39c1-cee6-4bb9-851b-a2fb14c9bb5e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:57.586686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f39c1-cee6-4bb9-851b-a2fb14c9bb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:57.610228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a24f39c1-cee6-4bb9-851b-a2fb14c9bb5e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:57.611408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a24f39c1-cee6-4bb9-851b-a2fb14c9bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:57.682551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 560/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:20:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:20:57.711665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84308501-af37-4549-8305-1ad7db50a083 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:57.826026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84308501-af37-4549-8305-1ad7db50a083 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:57.861731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:57.862368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:57.862650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:57.862929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] PATH_INFO: `/v3/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:57.864611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] RBAC: Authorizing `identity:get_role(role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:57.865994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:57.867335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 553/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:20:57 2022] GET /identity/v3/roles/fdf4549fa310408a94a78961b0a3fabc => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:57.874082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f39c1-cee6-4bb9-851b-a2fb14c9bb5e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:57.982189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f39c1-cee6-4bb9-851b-a2fb14c9bb5e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:57.998648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:58.019911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:58.020865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:58.021144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:58.021416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] PATH_INFO: `/v3/users/91eb36b93a544412b09adac5c20cd816` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:58.037717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] RBAC: Authorizing `identity:get_user(user_id=91eb36b93a544412b09adac5c20cd816)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:58.040219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:58.042858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 561/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:20:57 2022] GET /identity/v3/users/91eb36b93a544412b09adac5c20cd816 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:58.055187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:58.109170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:58.163831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483fcc8-925f-4d34-9ae7-77f7ebffa595 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:58.199022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:58.199661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:58.199937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:58.200207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:58.271832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:58.273275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:58.331140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:58.385851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 554/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:20:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:58.392107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:58.496781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8efb0e-663a-4c7f-b763-8da275d402dc None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:58.532223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52577a-2b5c-4036-9745-cf8815224144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:58.532856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52577a-2b5c-4036-9745-cf8815224144 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:58.533133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52577a-2b5c-4036-9745-cf8815224144 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:58.533407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52577a-2b5c-4036-9745-cf8815224144 None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:58.534699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52577a-2b5c-4036-9745-cf8815224144 None admin] RBAC: Authorizing `identity:get_project(project_id=2774562febce429ba0e164c4a93c99e1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:58.536168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52577a-2b5c-4036-9745-cf8815224144 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:58.537857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 562/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:20:58 2022] GET /identity/v3/projects/2774562febce429ba0e164c4a93c99e1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:58.545031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:58.651318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809eadb-3149-40b1-ae30-bf6dc8a3bec3 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:58.686067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af538ae4-131c-4236-b181-e1be5fdd4ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:58.686676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af538ae4-131c-4236-b181-e1be5fdd4ede None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:58.686954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af538ae4-131c-4236-b181-e1be5fdd4ede None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:58.687223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af538ae4-131c-4236-b181-e1be5fdd4ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:58.688031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af538ae4-131c-4236-b181-e1be5fdd4ede None admin] RBAC: Adding query filter params (role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=2774562febce429ba0e164c4a93c99e1, user.id=91eb36b93a544412b09adac5c20cd816) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:58.688335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af538ae4-131c-4236-b181-e1be5fdd4ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:58.689824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af538ae4-131c-4236-b181-e1be5fdd4ede None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:58.695247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 555/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:20:58 2022] GET /identity/v3/role_assignments?user.id=91eb36b93a544412b09adac5c20cd816&scope.project.id=2774562febce429ba0e164c4a93c99e1&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:00.635595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff526-1ccf-4508-bb2c-404180ce1e3b None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:00.636224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff526-1ccf-4508-bb2c-404180ce1e3b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:00.636224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff526-1ccf-4508-bb2c-404180ce1e3b None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:00.637551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 563/1118] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:00.642967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d8c1-b3e0-4e14-b877-52cc19af2658 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:00.643388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d8c1-b3e0-4e14-b877-52cc19af2658 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:00.643498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d8c1-b3e0-4e14-b877-52cc19af2658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:00.663669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-bab9d8c1-b3e0-4e14-b877-52cc19af2658 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:00.664872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bab9d8c1-b3e0-4e14-b877-52cc19af2658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:00.667638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:00.746307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 556/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:00.778774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff526-1ccf-4508-bb2c-404180ce1e3b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:00.836087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:00.903347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff526-1ccf-4508-bb2c-404180ce1e3b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:00.941679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:00.942343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:00.942634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:00.942907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] PATH_INFO: `/v3/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:00.944509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] RBAC: Authorizing `identity:get_role(role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:00.946223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:00.947609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 564/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:00 2022] GET /identity/v3/roles/fdf4549fa310408a94a78961b0a3fabc => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:00.954508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9d8c1-b3e0-4e14-b877-52cc19af2658 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:01.068536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9d8c1-b3e0-4e14-b877-52cc19af2658 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:01.105293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:01.105931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:01.106208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:01.106481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] PATH_INFO: `/v3/users/91eb36b93a544412b09adac5c20cd816` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:01.107802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] RBAC: Authorizing `identity:get_user(user_id=91eb36b93a544412b09adac5c20cd816)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:01.109251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:01.110878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 557/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:00 2022] GET /identity/v3/users/91eb36b93a544412b09adac5c20cd816 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:01.117109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:01.224498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d192b-ce91-4751-b6fc-c093c4630231 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:01.235090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:01.259934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018edc8-a5a4-47ab-b9e0-fddbb428bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:01.260576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018edc8-a5a4-47ab-b9e0-fddbb428bceb None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:01.260852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018edc8-a5a4-47ab-b9e0-fddbb428bceb None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:01.261130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018edc8-a5a4-47ab-b9e0-fddbb428bceb None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:01.262288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018edc8-a5a4-47ab-b9e0-fddbb428bceb None admin] RBAC: Authorizing `identity:get_project(project_id=2774562febce429ba0e164c4a93c99e1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:01.263748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018edc8-a5a4-47ab-b9e0-fddbb428bceb None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:01.265398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 565/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:01 2022] GET /identity/v3/projects/2774562febce429ba0e164c4a93c99e1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:01.272161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:01.288093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:01.381616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379dca5-7ed2-43f0-a857-d792916c07ad None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:01.416684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e2de4-5b71-4a2c-a6bb-7c7997f72888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:01.417339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2de4-5b71-4a2c-a6bb-7c7997f72888 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:01.417616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2de4-5b71-4a2c-a6bb-7c7997f72888 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:01.417892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2de4-5b71-4a2c-a6bb-7c7997f72888 None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1/users/91eb36b93a544412b09adac5c20cd816/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:01.420479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e2de4-5b71-4a2c-a6bb-7c7997f72888 None admin] RBAC: Authorizing `identity:create_grant(project_id=2774562febce429ba0e164c4a93c99e1, user_id=91eb36b93a544412b09adac5c20cd816, role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:01.421917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e2de4-5b71-4a2c-a6bb-7c7997f72888 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:01.438010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 558/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:21:01 2022] PUT /identity/v3/projects/2774562febce429ba0e164c4a93c99e1/users/91eb36b93a544412b09adac5c20cd816/roles/fdf4549fa310408a94a78961b0a3fabc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:03.382370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532e08-5afc-4efd-be5a-c1f23ec7fa0b None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:03.383250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532e08-5afc-4efd-be5a-c1f23ec7fa0b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:03.383250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532e08-5afc-4efd-be5a-c1f23ec7fa0b None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:03.385384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 566/1124] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:03.390747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ab45-1519-446f-9472-c38c9265865d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:03.391200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ab45-1519-446f-9472-c38c9265865d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:03.391298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ab45-1519-446f-9472-c38c9265865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:03.411383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6587ab45-1519-446f-9472-c38c9265865d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:03.412610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6587ab45-1519-446f-9472-c38c9265865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:03.475609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:03.486150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 559/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:03.513191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c532e08-5afc-4efd-be5a-c1f23ec7fa0b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:03.615190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c532e08-5afc-4efd-be5a-c1f23ec7fa0b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:03.649954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:03.650527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:03.650796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:03.651068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] PATH_INFO: `/v3/roles/fdf4549fa310408a94a78961b0a3fabc` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:03.652569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] RBAC: Authorizing `identity:get_role(role_id=fdf4549fa310408a94a78961b0a3fabc)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:03.653927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:03.655248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 567/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:03 2022] GET /identity/v3/roles/fdf4549fa310408a94a78961b0a3fabc => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:03.663581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ab45-1519-446f-9472-c38c9265865d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:03.776476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ab45-1519-446f-9472-c38c9265865d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:03.811042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:03.811698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:03.811973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:03.812242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] PATH_INFO: `/v3/users/91eb36b93a544412b09adac5c20cd816` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:03.813531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] RBAC: Authorizing `identity:get_user(user_id=91eb36b93a544412b09adac5c20cd816)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:03.814963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:03.816579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 560/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:03 2022] GET /identity/v3/users/91eb36b93a544412b09adac5c20cd816 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:03.826167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:03.880794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:03.941594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f10838-6b4a-480c-8b76-5381ceb393dc None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:03.979047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:03.979667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:03.979968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:03.980240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.052272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.053712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.100054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:04.156106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 568/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:21:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:04.162754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.246242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:04.283596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d246a-3f5c-42b0-ab3b-bc3f1458fdff None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:04.318771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da6ab9-a4e5-4253-8859-17a43131277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:04.319398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6ab9-a4e5-4253-8859-17a43131277a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.319760 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6ab9-a4e5-4253-8859-17a43131277a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.320036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6ab9-a4e5-4253-8859-17a43131277a None admin] PATH_INFO: `/v3/projects/2774562febce429ba0e164c4a93c99e1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.321654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da6ab9-a4e5-4253-8859-17a43131277a None admin] RBAC: Authorizing `identity:get_project(project_id=2774562febce429ba0e164c4a93c99e1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.323086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da6ab9-a4e5-4253-8859-17a43131277a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.324752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 561/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:04 2022] GET /identity/v3/projects/2774562febce429ba0e164c4a93c99e1 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:21:04.332055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.436891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a5c56-032e-4c04-b900-97f8d8ab4caa None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:04.476329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc39d47-5d30-4092-a66b-6f42419f58e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:04.476932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc39d47-5d30-4092-a66b-6f42419f58e4 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.477205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc39d47-5d30-4092-a66b-6f42419f58e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.477469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc39d47-5d30-4092-a66b-6f42419f58e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.478238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc39d47-5d30-4092-a66b-6f42419f58e4 None admin] RBAC: Adding query filter params (role.id=fdf4549fa310408a94a78961b0a3fabc, scope.project.id=2774562febce429ba0e164c4a93c99e1, user.id=91eb36b93a544412b09adac5c20cd816) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:04.478539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc39d47-5d30-4092-a66b-6f42419f58e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.480006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc39d47-5d30-4092-a66b-6f42419f58e4 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.485770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 569/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:21:04 2022] GET /identity/v3/role_assignments?user.id=91eb36b93a544412b09adac5c20cd816&scope.project.id=2774562febce429ba0e164c4a93c99e1&role.id=fdf4549fa310408a94a78961b0a3fabc => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:06.459392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374760ad-7274-455b-831f-22b34f29f6a6 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:06.459967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374760ad-7274-455b-831f-22b34f29f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:06.459967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374760ad-7274-455b-831f-22b34f29f6a6 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:06.461324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 562/1131] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:06.467681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523e98-1d3a-4d14-b699-91117c303939 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:06.468401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523e98-1d3a-4d14-b699-91117c303939 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:06.468539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523e98-1d3a-4d14-b699-91117c303939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:06.489602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-05523e98-1d3a-4d14-b699-91117c303939 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:06.490799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-05523e98-1d3a-4d14-b699-91117c303939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:06.493580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:06.570857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 570/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:06.593857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374760ad-7274-455b-831f-22b34f29f6a6 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:06.701039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374760ad-7274-455b-831f-22b34f29f6a6 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:06.736170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fd1ae-ebb2-45ce-9753-7ae0d3cab308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:06.736733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fd1ae-ebb2-45ce-9753-7ae0d3cab308 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:06.737007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fd1ae-ebb2-45ce-9753-7ae0d3cab308 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:06.737285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fd1ae-ebb2-45ce-9753-7ae0d3cab308 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:06.738457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fd1ae-ebb2-45ce-9753-7ae0d3cab308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:06.739987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fd1ae-ebb2-45ce-9753-7ae0d3cab308 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:06.741552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 563/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:06.748105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523e98-1d3a-4d14-b699-91117c303939 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:06.858552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523e98-1d3a-4d14-b699-91117c303939 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:06.893939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928a8a-94f0-44bc-84f9-bfa5e73c5452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:06.894553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928a8a-94f0-44bc-84f9-bfa5e73c5452 None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:06.894831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928a8a-94f0-44bc-84f9-bfa5e73c5452 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:06.895069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928a8a-94f0-44bc-84f9-bfa5e73c5452 None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:06.895853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928a8a-94f0-44bc-84f9-bfa5e73c5452 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:06.897279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928a8a-94f0-44bc-84f9-bfa5e73c5452 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:06.908605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:06.927861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 571/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:21:06 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:09.019034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d5607-f3cd-416d-81ad-83ec64e7220a None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.019644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d5607-f3cd-416d-81ad-83ec64e7220a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.019644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d5607-f3cd-416d-81ad-83ec64e7220a None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.021375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 564/1135] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:09.027476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c2c8-8ad4-4122-b39f-4475de85e34b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.027916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c2c8-8ad4-4122-b39f-4475de85e34b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.028307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c2c8-8ad4-4122-b39f-4475de85e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.053894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5f78c2c8-8ad4-4122-b39f-4475de85e34b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:09.055114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5f78c2c8-8ad4-4122-b39f-4475de85e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:09.131150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 572/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:09.161672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d5607-f3cd-416d-81ad-83ec64e7220a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:09.164896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:09.267885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d5607-f3cd-416d-81ad-83ec64e7220a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:09.303659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e3f1e-26b7-4dcf-9280-cfcb69972eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:09.304236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3f1e-26b7-4dcf-9280-cfcb69972eed None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.304512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3f1e-26b7-4dcf-9280-cfcb69972eed None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.304786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3f1e-26b7-4dcf-9280-cfcb69972eed None admin] PATH_INFO: `/v3/domains/default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.306071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e3f1e-26b7-4dcf-9280-cfcb69972eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:09.307519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e3f1e-26b7-4dcf-9280-cfcb69972eed None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:09.309133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 565/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:21:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:09.315106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78c2c8-8ad4-4122-b39f-4475de85e34b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:09.419670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78c2c8-8ad4-4122-b39f-4475de85e34b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:09.442816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:09.456589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f93d2f-1522-44a6-9e59-a67b9f63b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:09.457212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f93d2f-1522-44a6-9e59-a67b9f63b18a None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.457514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f93d2f-1522-44a6-9e59-a67b9f63b18a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.457795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f93d2f-1522-44a6-9e59-a67b9f63b18a None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.458470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f93d2f-1522-44a6-9e59-a67b9f63b18a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:09.459947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f93d2f-1522-44a6-9e59-a67b9f63b18a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:09.482341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 573/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:21:09 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:11.502240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4529ff5-5c3e-4b95-a416-0a086bd9d275 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:11.503087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4529ff5-5c3e-4b95-a416-0a086bd9d275 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:11.503087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4529ff5-5c3e-4b95-a416-0a086bd9d275 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:11.505327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 566/1139] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:11.510841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06d70-8805-4668-a0ce-020d70e2a8b5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:11.511276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06d70-8805-4668-a0ce-020d70e2a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:11.511368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06d70-8805-4668-a0ce-020d70e2a8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:11.530946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7ac06d70-8805-4668-a0ce-020d70e2a8b5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:11.532173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7ac06d70-8805-4668-a0ce-020d70e2a8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:11.601123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 574/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:11.625420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4529ff5-5c3e-4b95-a416-0a086bd9d275 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:11.717159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:11.754196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4529ff5-5c3e-4b95-a416-0a086bd9d275 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:11.789788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:11.790416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:11.790692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:11.790963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:11.801651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:21:11.806482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:21:11.807601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:21:11.808661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 567/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:21:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:21:11.814209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06d70-8805-4668-a0ce-020d70e2a8b5 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:11.918386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06d70-8805-4668-a0ce-020d70e2a8b5 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:11.927673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:11.954711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:11.955324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:11.955599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:11.955899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:11.956602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:11.956901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:11.958283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:11.967103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 575/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:21:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:11.975652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:12.086956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b677e-a11b-40fb-87f1-9f9f76470d9c None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:12.116385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:12.126590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:12.127542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:12.127883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:12.128243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] PATH_INFO: `/v3/users/b78a80f95fb841ebb0eabeb474c8d6a8` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:12.149079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] RBAC: Authorizing `identity:get_user(user_id=b78a80f95fb841ebb0eabeb474c8d6a8)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:12.150527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:12.152178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 568/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:11 2022] GET /identity/v3/users/b78a80f95fb841ebb0eabeb474c8d6a8 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:21:12.158274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:12.260146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8592-48d4-4323-869d-f2048bbcee41 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:12.295028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:12.295572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:12.295880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:12.296152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:12.335669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:12.364989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:12.366415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:12.466241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 576/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:21:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:12.474946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:12.595059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621dd58-4380-462c-9e94-2acc2e1b286a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:12.630572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d19422-5af2-4f71-9e53-9dc6ace99940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:12.631202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d19422-5af2-4f71-9e53-9dc6ace99940 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:12.631482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d19422-5af2-4f71-9e53-9dc6ace99940 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:12.631788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d19422-5af2-4f71-9e53-9dc6ace99940 None admin] PATH_INFO: `/v3/projects/fe18bdaa7eac472b979e1d530e855d01` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:12.632987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d19422-5af2-4f71-9e53-9dc6ace99940 None admin] RBAC: Authorizing `identity:get_project(project_id=fe18bdaa7eac472b979e1d530e855d01)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:12.634421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d19422-5af2-4f71-9e53-9dc6ace99940 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:12.636102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 569/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:12 2022] GET /identity/v3/projects/fe18bdaa7eac472b979e1d530e855d01 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:12.642614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:12.716727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:12.747977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86885b6-fc5a-4e8e-9866-5cb6b7901fa3 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:12.783742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b68e4-6c62-4c7e-a79c-1919a2846aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:12.784349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b68e4-6c62-4c7e-a79c-1919a2846aa2 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:12.784629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b68e4-6c62-4c7e-a79c-1919a2846aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:12.784897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b68e4-6c62-4c7e-a79c-1919a2846aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:12.785707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b68e4-6c62-4c7e-a79c-1919a2846aa2 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=fe18bdaa7eac472b979e1d530e855d01, user.id=b78a80f95fb841ebb0eabeb474c8d6a8) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:12.786014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b68e4-6c62-4c7e-a79c-1919a2846aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:12.787430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b68e4-6c62-4c7e-a79c-1919a2846aa2 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:12.793060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 577/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:21:12 2022] GET /identity/v3/role_assignments?user.id=b78a80f95fb841ebb0eabeb474c8d6a8&scope.project.id=fe18bdaa7eac472b979e1d530e855d01&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:14.752401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dd143-6b8b-4525-bfe0-745fd17b5fb4 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.753304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dd143-6b8b-4525-bfe0-745fd17b5fb4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.753304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dd143-6b8b-4525-bfe0-745fd17b5fb4 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.755178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 570/1147] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:14.761541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5881-27b1-4ce3-aa03-626019542df2 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.761972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5881-27b1-4ce3-aa03-626019542df2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.762165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5881-27b1-4ce3-aa03-626019542df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.794737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-964f5881-27b1-4ce3-aa03-626019542df2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:14.796438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-964f5881-27b1-4ce3-aa03-626019542df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:14.881210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 578/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:14.914849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dd143-6b8b-4525-bfe0-745fd17b5fb4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.978677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:15.025881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dd143-6b8b-4525-bfe0-745fd17b5fb4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:15.070056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:15.071444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:15.071858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:15.072270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:15.087427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:21:15.092279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:21:15.093362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:21:15.094389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 571/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:21:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:21:15.100521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f5881-27b1-4ce3-aa03-626019542df2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:15.172393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:15.224277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f5881-27b1-4ce3-aa03-626019542df2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:15.262286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:15.262897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:15.263172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:15.263443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:15.264180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:15.264476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:15.265843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:15.274213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 579/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:15.282929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:15.387025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd7d05-da3e-42db-9ff1-1c71edc14650 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:15.406155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:15.425506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:15.426140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:15.426417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:15.426685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] PATH_INFO: `/v3/users/b78a80f95fb841ebb0eabeb474c8d6a8` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:15.427947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] RBAC: Authorizing `identity:get_user(user_id=b78a80f95fb841ebb0eabeb474c8d6a8)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:15.429382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:15.430987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 572/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:15 2022] GET /identity/v3/users/b78a80f95fb841ebb0eabeb474c8d6a8 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:15.436888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:15.550301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79e971-f5ae-4e76-a164-bb7faec657f6 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:15.575787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:15.585943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad5cdb-540b-4190-a0f0-644add8cb163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:15.586579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad5cdb-540b-4190-a0f0-644add8cb163 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:15.586855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad5cdb-540b-4190-a0f0-644add8cb163 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:15.587128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad5cdb-540b-4190-a0f0-644add8cb163 None admin] PATH_INFO: `/v3/projects/fe18bdaa7eac472b979e1d530e855d01` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:15.588301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad5cdb-540b-4190-a0f0-644add8cb163 None admin] RBAC: Authorizing `identity:get_project(project_id=fe18bdaa7eac472b979e1d530e855d01)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:15.589732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad5cdb-540b-4190-a0f0-644add8cb163 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:15.591381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 580/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:15 2022] GET /identity/v3/projects/fe18bdaa7eac472b979e1d530e855d01 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:15.597663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:15.710705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827b1d-61c1-41b3-9f6d-569fa1f2ff13 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:15.747005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ff92-f4a7-4386-896b-399e97aa3a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:15.747653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ff92-f4a7-4386-896b-399e97aa3a73 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:15.747962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ff92-f4a7-4386-896b-399e97aa3a73 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:15.748249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ff92-f4a7-4386-896b-399e97aa3a73 None admin] PATH_INFO: `/v3/projects/fe18bdaa7eac472b979e1d530e855d01/users/b78a80f95fb841ebb0eabeb474c8d6a8/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:15.750467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89ff92-f4a7-4386-896b-399e97aa3a73 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe18bdaa7eac472b979e1d530e855d01, user_id=b78a80f95fb841ebb0eabeb474c8d6a8, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:15.751946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89ff92-f4a7-4386-896b-399e97aa3a73 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:15.768557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 573/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:21:15 2022] PUT /identity/v3/projects/fe18bdaa7eac472b979e1d530e855d01/users/b78a80f95fb841ebb0eabeb474c8d6a8/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:17.694168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b42b-cc95-49df-a932-32521a3299f9 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:17.695072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b42b-cc95-49df-a932-32521a3299f9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:17.695072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b42b-cc95-49df-a932-32521a3299f9 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:17.697496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 581/1154] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:17.703775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f78f9-5314-40f6-ade4-332da429b24d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:17.704504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f78f9-5314-40f6-ade4-332da429b24d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:17.704670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f78f9-5314-40f6-ade4-332da429b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:17.732328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-081f78f9-5314-40f6-ade4-332da429b24d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:17.733538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-081f78f9-5314-40f6-ade4-332da429b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:17.777694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:17.812020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 574/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:17.844860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b42b-cc95-49df-a932-32521a3299f9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:17.956249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b42b-cc95-49df-a932-32521a3299f9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:17.990835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:17.991477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:17.991791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:17.992069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:18.003087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:21:18.008014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:21:18.009057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:21:18.009951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 582/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:21:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:21:18.017789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f78f9-5314-40f6-ade4-332da429b24d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:18.123784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f78f9-5314-40f6-ade4-332da429b24d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:18.159361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:18.160000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:18.160304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:18.160575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:18.161281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:18.161577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:18.162943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:18.173297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 575/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:21:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:18.179356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:18.237667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:18.287668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641da75-9bd3-42c3-8ead-1f0ef8cf0941 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:18.323466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:18.324135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:18.324418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:18.324694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] PATH_INFO: `/v3/users/b78a80f95fb841ebb0eabeb474c8d6a8` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:18.325993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] RBAC: Authorizing `identity:get_user(user_id=b78a80f95fb841ebb0eabeb474c8d6a8)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:18.327436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:18.329092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 583/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:18 2022] GET /identity/v3/users/b78a80f95fb841ebb0eabeb474c8d6a8 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:18.336403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:18.380548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:18.450103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb3d6-66ed-4580-9d23-fe40452ffa65 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:18.484846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:18.485454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:18.485728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:18.486003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:18.560811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:18.562182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:18.596402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:18.676770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 576/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:21:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:18.685518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:18.803563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa9ea4-f375-4939-af27-24a8f1ca1f2c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:18.826420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:18.838855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c80f3-7022-4a1a-aba6-276d95496c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:18.839497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c80f3-7022-4a1a-aba6-276d95496c5c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:18.839802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c80f3-7022-4a1a-aba6-276d95496c5c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:18.840080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c80f3-7022-4a1a-aba6-276d95496c5c None admin] PATH_INFO: `/v3/projects/fe18bdaa7eac472b979e1d530e855d01` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:18.841317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c80f3-7022-4a1a-aba6-276d95496c5c None admin] RBAC: Authorizing `identity:get_project(project_id=fe18bdaa7eac472b979e1d530e855d01)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:18.842745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c80f3-7022-4a1a-aba6-276d95496c5c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:18.844450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 584/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:18 2022] GET /identity/v3/projects/fe18bdaa7eac472b979e1d530e855d01 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:18.851383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:18.957384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3ee46-0358-469b-9c13-20b88799e0d9 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:18.994798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8acad-ac6c-4191-a772-13bf37bd81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:18.995410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8acad-ac6c-4191-a772-13bf37bd81c5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:18.995698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8acad-ac6c-4191-a772-13bf37bd81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:18.996002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8acad-ac6c-4191-a772-13bf37bd81c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:18.996771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8acad-ac6c-4191-a772-13bf37bd81c5 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=fe18bdaa7eac472b979e1d530e855d01, user.id=b78a80f95fb841ebb0eabeb474c8d6a8) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:18.997082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8acad-ac6c-4191-a772-13bf37bd81c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:18.998526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8acad-ac6c-4191-a772-13bf37bd81c5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:19.001462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:19.004973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 577/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:21:18 2022] GET /identity/v3/role_assignments?user.id=b78a80f95fb841ebb0eabeb474c8d6a8&scope.project.id=fe18bdaa7eac472b979e1d530e855d01&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:20.983865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367fe7-2417-4ba1-8391-a26ff3e4ae7c None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:20.984751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367fe7-2417-4ba1-8391-a26ff3e4ae7c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:20.984751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367fe7-2417-4ba1-8391-a26ff3e4ae7c None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:20.986894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 585/1162] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:20.993755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee239b-1840-4e5f-811b-f5896f4233d4 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:20.994193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee239b-1840-4e5f-811b-f5896f4233d4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:20.994319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee239b-1840-4e5f-811b-f5896f4233d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.022267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a4ee239b-1840-4e5f-811b-f5896f4233d4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:21.025296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a4ee239b-1840-4e5f-811b-f5896f4233d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:21.095714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 578/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:21.118132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c367fe7-2417-4ba1-8391-a26ff3e4ae7c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.228100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c367fe7-2417-4ba1-8391-a26ff3e4ae7c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.266516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.267065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.267346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.267636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.326187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:21.339146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.340650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.443284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 586/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:21:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:21.452810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee239b-1840-4e5f-811b-f5896f4233d4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.555370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee239b-1840-4e5f-811b-f5896f4233d4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.584505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:21.594612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271f55d-e9fa-4af4-8ce9-c1d5eae89a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.595590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f55d-e9fa-4af4-8ce9-c1d5eae89a48 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.596002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f55d-e9fa-4af4-8ce9-c1d5eae89a48 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.596392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f55d-e9fa-4af4-8ce9-c1d5eae89a48 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.604384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271f55d-e9fa-4af4-8ce9-c1d5eae89a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.605837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271f55d-e9fa-4af4-8ce9-c1d5eae89a48 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-7271f55d-e9fa-4af4-8ce9-c1d5eae89a48 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:21:21.618701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:21:21.620018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:21:21.620899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 579/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:21:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:21:21.626144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.718231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:21.727969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb846f1-6d8f-4d93-995f-b2a0a5374c34 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.762922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6de5d-cfff-45eb-b162-78c9036f32fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.763533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6de5d-cfff-45eb-b162-78c9036f32fa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.763850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6de5d-cfff-45eb-b162-78c9036f32fa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.764118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6de5d-cfff-45eb-b162-78c9036f32fa None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.764795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6de5d-cfff-45eb-b162-78c9036f32fa None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:21.765111 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6de5d-cfff-45eb-b162-78c9036f32fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.766471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6de5d-cfff-45eb-b162-78c9036f32fa None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.773651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 587/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Jul 28 06:21:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:23.776378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c5cae-0872-4896-a861-6dca42c99c4b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:23.777242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c5cae-0872-4896-a861-6dca42c99c4b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:23.777411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c5cae-0872-4896-a861-6dca42c99c4b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:23.779506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 580/1167] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:23.785784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad134e8-12bc-4540-9812-1685c2c50355 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:23.786204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad134e8-12bc-4540-9812-1685c2c50355 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:23.786322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad134e8-12bc-4540-9812-1685c2c50355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:23.805465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0ad134e8-12bc-4540-9812-1685c2c50355 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:23.806662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0ad134e8-12bc-4540-9812-1685c2c50355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:23.877821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 588/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:23.900936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c5cae-0872-4896-a861-6dca42c99c4b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.014130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c5cae-0872-4896-a861-6dca42c99c4b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.060410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a43a71-5803-4a80-aba9-f1c173c2918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.061042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43a71-5803-4a80-aba9-f1c173c2918a None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.061317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43a71-5803-4a80-aba9-f1c173c2918a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.061605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43a71-5803-4a80-aba9-f1c173c2918a None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.062298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a43a71-5803-4a80-aba9-f1c173c2918a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.063756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a43a71-5803-4a80-aba9-f1c173c2918a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.082476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 581/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Thu Jul 28 06:21:23 2022] POST /identity/v3/domains => generated 267 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:26.082407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcd15d-7ef4-4f63-a500-67ca8c178b8e None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:26.083140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcd15d-7ef4-4f63-a500-67ca8c178b8e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:26.083335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcd15d-7ef4-4f63-a500-67ca8c178b8e None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:26.085508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 589/1170] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:26.093488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973a327-ff40-47c4-bdc8-1aa6a5cd3443 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:26.093968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973a327-ff40-47c4-bdc8-1aa6a5cd3443 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:26.094116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973a327-ff40-47c4-bdc8-1aa6a5cd3443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:26.114105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e973a327-ff40-47c4-bdc8-1aa6a5cd3443 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:26.115293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e973a327-ff40-47c4-bdc8-1aa6a5cd3443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:26.167495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:26.199507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 582/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:21:26.223000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcd15d-7ef4-4f63-a500-67ca8c178b8e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:26.316547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:26.342324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcd15d-7ef4-4f63-a500-67ca8c178b8e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:26.382243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfffbf6-f7a8-445e-b706-e6c1f0c1cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:26.382887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfffbf6-f7a8-445e-b706-e6c1f0c1cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:26.383166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfffbf6-f7a8-445e-b706-e6c1f0c1cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:26.383440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfffbf6-f7a8-445e-b706-e6c1f0c1cbf1 None admin] PATH_INFO: `/v3/domains/db9f9fff1a074806b1f22e1e5dbc6ae6` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:26.395326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfffbf6-f7a8-445e-b706-e6c1f0c1cbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=db9f9fff1a074806b1f22e1e5dbc6ae6)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:26.396800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfffbf6-f7a8-445e-b706-e6c1f0c1cbf1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:26.398419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 590/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Thu Jul 28 06:21:26 2022] GET /identity/v3/domains/db9f9fff1a074806b1f22e1e5dbc6ae6 => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:26.405226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973a327-ff40-47c4-bdc8-1aa6a5cd3443 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:26.514683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973a327-ff40-47c4-bdc8-1aa6a5cd3443 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:26.551135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82087135-6e25-40d9-be8d-1179f462f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:26.551811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82087135-6e25-40d9-be8d-1179f462f792 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:26.552087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82087135-6e25-40d9-be8d-1179f462f792 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:26.552360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82087135-6e25-40d9-be8d-1179f462f792 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:26.553038 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82087135-6e25-40d9-be8d-1179f462f792 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:26.554497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82087135-6e25-40d9-be8d-1179f462f792 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:26.584894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 583/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:21:26 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:28.590548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bfb68-4bd5-4846-8b4a-a959780600f3 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.591449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bfb68-4bd5-4846-8b4a-a959780600f3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.591449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bfb68-4bd5-4846-8b4a-a959780600f3 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.593705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 591/1174] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:28.600173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79711304-5f7d-4bd7-87fd-4dd2607b0d2f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.600873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79711304-5f7d-4bd7-87fd-4dd2607b0d2f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.601032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79711304-5f7d-4bd7-87fd-4dd2607b0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.624349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-79711304-5f7d-4bd7-87fd-4dd2607b0d2f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:28.625537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-79711304-5f7d-4bd7-87fd-4dd2607b0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:28.652400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:28.708779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 584/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:28.745176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bfb68-4bd5-4846-8b4a-a959780600f3 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.871340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bfb68-4bd5-4846-8b4a-a959780600f3 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.910883 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c95c-3550-4120-b638-648b5117ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.911520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c95c-3550-4120-b638-648b5117ad43 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.911828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c95c-3550-4120-b638-648b5117ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.912097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c95c-3550-4120-b638-648b5117ad43 None admin] PATH_INFO: `/v3/domains/db9f9fff1a074806b1f22e1e5dbc6ae6` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.913578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7c95c-3550-4120-b638-648b5117ad43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=db9f9fff1a074806b1f22e1e5dbc6ae6)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.915002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7c95c-3550-4120-b638-648b5117ad43 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.916632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 592/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Thu Jul 28 06:21:28 2022] GET /identity/v3/domains/db9f9fff1a074806b1f22e1e5dbc6ae6 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:28.923603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79711304-5f7d-4bd7-87fd-4dd2607b0d2f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:29.035869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79711304-5f7d-4bd7-87fd-4dd2607b0d2f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:29.080636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0505431-a41e-412a-a20a-74e44a37786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:29.081258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505431-a41e-412a-a20a-74e44a37786d None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:29.081581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505431-a41e-412a-a20a-74e44a37786d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:29.081852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505431-a41e-412a-a20a-74e44a37786d None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:29.082534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0505431-a41e-412a-a20a-74e44a37786d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:29.084072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0505431-a41e-412a-a20a-74e44a37786d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:29.109077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 585/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:21:28 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:31.128791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8e514-fd89-47bd-b536-e175fcc95681 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:31.129695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8e514-fd89-47bd-b536-e175fcc95681 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:31.129695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8e514-fd89-47bd-b536-e175fcc95681 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:31.131965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 593/1178] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:31.141346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02ce9f-4bbc-4f43-9cc3-49b609171e18 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:31.142055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02ce9f-4bbc-4f43-9cc3-49b609171e18 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:31.142223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02ce9f-4bbc-4f43-9cc3-49b609171e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:31.169107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7d02ce9f-4bbc-4f43-9cc3-49b609171e18 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:31.170312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7d02ce9f-4bbc-4f43-9cc3-49b609171e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:31.184693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:31.248801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 586/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:31.272158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8e514-fd89-47bd-b536-e175fcc95681 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:31.289880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:31.383611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8e514-fd89-47bd-b536-e175fcc95681 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:31.417519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:31.418156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:31.418429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:31.418687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:31.429200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:21:31.434067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:21:31.435116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:21:31.436014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 594/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:21:31.443204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02ce9f-4bbc-4f43-9cc3-49b609171e18 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:31.546263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02ce9f-4bbc-4f43-9cc3-49b609171e18 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:31.582015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:31.582622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:31.582895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:31.583166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:31.583901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:31.584179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:31.585562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:31.593586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 587/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:31.599647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:31.679297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:31.711529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27502a22-8811-4504-ac13-87288afedb30 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:31.746421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:31.747049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:31.747328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:31.747605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] PATH_INFO: `/v3/users/a6255cde29d24837a97eb0fe95a4bdbb` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:31.762015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] RBAC: Authorizing `identity:get_user(user_id=a6255cde29d24837a97eb0fe95a4bdbb)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:31.763466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:31.765158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 595/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:31 2022] GET /identity/v3/users/a6255cde29d24837a97eb0fe95a4bdbb => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:31.771258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:31.784671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:31.880252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce11e5-60b4-4492-8074-9f23afb17366 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:31.914354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:31.914957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:31.915233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:31.915503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:32.000940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:32.002391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:32.013960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:32.108276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 588/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:21:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:32.115280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:32.234581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e84f-5d3c-4c3d-bea2-9ca3fa5dc414 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:32.267036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:32.275607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8142-0d51-4223-b2c4-3c4f2badfb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:32.276626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8142-0d51-4223-b2c4-3c4f2badfb33 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:32.277014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8142-0d51-4223-b2c4-3c4f2badfb33 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:32.277434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8142-0d51-4223-b2c4-3c4f2badfb33 None admin] PATH_INFO: `/v3/projects/7b06b05df20c422b8398d84609a4d9ce` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:32.279508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8142-0d51-4223-b2c4-3c4f2badfb33 None admin] RBAC: Authorizing `identity:get_project(project_id=7b06b05df20c422b8398d84609a4d9ce)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:32.281877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8142-0d51-4223-b2c4-3c4f2badfb33 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:32.284590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 596/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:32 2022] GET /identity/v3/projects/7b06b05df20c422b8398d84609a4d9ce => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:32.291118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:32.391830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29384c8f-6d69-4baf-acdd-82c1be44e981 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:32.402327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:32.427798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b66c0-2a62-4d3e-b6ec-c2d7d549e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:32.428405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b66c0-2a62-4d3e-b6ec-c2d7d549e281 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:32.428682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b66c0-2a62-4d3e-b6ec-c2d7d549e281 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:32.428949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b66c0-2a62-4d3e-b6ec-c2d7d549e281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:32.429723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b66c0-2a62-4d3e-b6ec-c2d7d549e281 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=7b06b05df20c422b8398d84609a4d9ce, user.id=a6255cde29d24837a97eb0fe95a4bdbb) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:32.430032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b66c0-2a62-4d3e-b6ec-c2d7d549e281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:32.431465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b66c0-2a62-4d3e-b6ec-c2d7d549e281 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:32.436961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 589/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:21:32 2022] GET /identity/v3/role_assignments?user.id=a6255cde29d24837a97eb0fe95a4bdbb&scope.project.id=7b06b05df20c422b8398d84609a4d9ce&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:34.371454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cf035-8464-4aa2-ba4e-a36e73055592 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:34.372042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cf035-8464-4aa2-ba4e-a36e73055592 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:34.372042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cf035-8464-4aa2-ba4e-a36e73055592 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:34.374007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 597/1186] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:34.381244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dbe1c-5860-4f8d-b198-f5a9ef90c238 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:34.381714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dbe1c-5860-4f8d-b198-f5a9ef90c238 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:34.381813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dbe1c-5860-4f8d-b198-f5a9ef90c238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:34.408077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-723dbe1c-5860-4f8d-b198-f5a9ef90c238 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:34.409918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-723dbe1c-5860-4f8d-b198-f5a9ef90c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:34.485211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 590/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:21:34.513755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cf035-8464-4aa2-ba4e-a36e73055592 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:34.625135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cf035-8464-4aa2-ba4e-a36e73055592 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:34.660382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:34.661014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:34.661320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:34.661597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:34.672913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:21:34.678201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:21:34.679318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:21:34.680753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 598/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:21:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:21:34.688142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dbe1c-5860-4f8d-b198-f5a9ef90c238 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:34.795664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dbe1c-5860-4f8d-b198-f5a9ef90c238 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:34.798071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:34.835028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:34.835667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:34.835938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:34.836208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:34.836913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:34.837211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:34.838591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:34.846603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 591/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:34.852713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:34.912398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:34.955470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa67209-240e-4464-831b-5f6628495635 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:34.990903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:34.991546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:34.991862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:34.992137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] PATH_INFO: `/v3/users/a6255cde29d24837a97eb0fe95a4bdbb` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:34.993500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] RBAC: Authorizing `identity:get_user(user_id=a6255cde29d24837a97eb0fe95a4bdbb)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:34.994948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:34.996608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 599/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:34 2022] GET /identity/v3/users/a6255cde29d24837a97eb0fe95a4bdbb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:35.002873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:35.115083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba747893-e86d-4974-890c-c367d49e4943 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:35.149720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ebe2a-e544-4aac-8afa-117b4a98fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:35.150353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebe2a-e544-4aac-8afa-117b4a98fb10 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:35.150627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebe2a-e544-4aac-8afa-117b4a98fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:35.150891 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebe2a-e544-4aac-8afa-117b4a98fb10 None admin] PATH_INFO: `/v3/projects/7b06b05df20c422b8398d84609a4d9ce` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:35.152119 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ebe2a-e544-4aac-8afa-117b4a98fb10 None admin] RBAC: Authorizing `identity:get_project(project_id=7b06b05df20c422b8398d84609a4d9ce)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:35.153560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ebe2a-e544-4aac-8afa-117b4a98fb10 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:35.155201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 592/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:35 2022] GET /identity/v3/projects/7b06b05df20c422b8398d84609a4d9ce => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:35.163156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:35.283396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91130c-1b18-4dae-a739-b34b7adcc666 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:35.311422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:35.321996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b3b12-f6f8-4c34-9bc9-4ff0f2e951c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:35.322672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3b12-f6f8-4c34-9bc9-4ff0f2e951c5 None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:35.322960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3b12-f6f8-4c34-9bc9-4ff0f2e951c5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:35.323235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3b12-f6f8-4c34-9bc9-4ff0f2e951c5 None admin] PATH_INFO: `/v3/projects/7b06b05df20c422b8398d84609a4d9ce/users/a6255cde29d24837a97eb0fe95a4bdbb/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:35.325301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b3b12-f6f8-4c34-9bc9-4ff0f2e951c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b06b05df20c422b8398d84609a4d9ce, user_id=a6255cde29d24837a97eb0fe95a4bdbb, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:35.326752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b3b12-f6f8-4c34-9bc9-4ff0f2e951c5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:35.341426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 600/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:21:35 2022] PUT /identity/v3/projects/7b06b05df20c422b8398d84609a4d9ce/users/a6255cde29d24837a97eb0fe95a4bdbb/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:21:37.264877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51b46-83ce-465b-9134-3d7e57b704b1 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:37.265775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51b46-83ce-465b-9134-3d7e57b704b1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:37.265775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51b46-83ce-465b-9134-3d7e57b704b1 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:37.267894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 593/1193] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:21:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:21:37.276717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bb80b-78be-43b3-9116-3565e2ceb49b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:37.277562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bb80b-78be-43b3-9116-3565e2ceb49b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:37.277764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bb80b-78be-43b3-9116-3565e2ceb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:37.299416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f40bb80b-78be-43b3-9116-3565e2ceb49b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:37.300655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f40bb80b-78be-43b3-9116-3565e2ceb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:37.370482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 601/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:21:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:21:37.396820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51b46-83ce-465b-9134-3d7e57b704b1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:37.452901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:37.534036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51b46-83ce-465b-9134-3d7e57b704b1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:37.575441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:37.576126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:37.576409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:37.576684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:37.589772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:21:37.594637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:21:37.595800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:21:37.596755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 594/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:21:37.602302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bb80b-78be-43b3-9116-3565e2ceb49b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:37.710835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bb80b-78be-43b3-9116-3565e2ceb49b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:37.728649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:37.748369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:37.748984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:37.749262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:37.749532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:37.750246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:37.750551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:37.752082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:37.760234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 602/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:21:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:37.766126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:37.867317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:37.877282 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd49136-84d6-431d-9938-c45e4c642c7a None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:37.920053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:37.920696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:37.920977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:37.921249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] PATH_INFO: `/v3/users/a6255cde29d24837a97eb0fe95a4bdbb` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:37.922551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] RBAC: Authorizing `identity:get_user(user_id=a6255cde29d24837a97eb0fe95a4bdbb)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:37.924024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:37.925687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 595/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Jul 28 06:21:37 2022] GET /identity/v3/users/a6255cde29d24837a97eb0fe95a4bdbb => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:37.934934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:38.047038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad12e-e068-4dea-8971-e0407088f6b9 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:38.082978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:38.083606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:38.083911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:38.084184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:38.136735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:38.160510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:38.161982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:38.263105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 603/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:21:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:38.269510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:38.378231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b99e8-fe11-4fa2-9608-f54085a2ecca None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:38.414586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772ecbd-53f6-408a-8143-e0952e09b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:38.415146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772ecbd-53f6-408a-8143-e0952e09b508 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:38.415393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772ecbd-53f6-408a-8143-e0952e09b508 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:38.415720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772ecbd-53f6-408a-8143-e0952e09b508 None admin] PATH_INFO: `/v3/projects/7b06b05df20c422b8398d84609a4d9ce` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:38.416887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772ecbd-53f6-408a-8143-e0952e09b508 None admin] RBAC: Authorizing `identity:get_project(project_id=7b06b05df20c422b8398d84609a4d9ce)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:38.418329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772ecbd-53f6-408a-8143-e0952e09b508 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:38.420012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 596/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Jul 28 06:21:38 2022] GET /identity/v3/projects/7b06b05df20c422b8398d84609a4d9ce => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:38.426454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:38.506123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:38.529803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ace0-a8ac-4620-ac72-fd142413f4ae None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:38.565833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f32cd-c9e6-41d6-87b9-d1fb79544556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:38.566442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f32cd-c9e6-41d6-87b9-d1fb79544556 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:38.566718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f32cd-c9e6-41d6-87b9-d1fb79544556 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:38.566966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f32cd-c9e6-41d6-87b9-d1fb79544556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:38.567874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f32cd-c9e6-41d6-87b9-d1fb79544556 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=7b06b05df20c422b8398d84609a4d9ce, user.id=a6255cde29d24837a97eb0fe95a4bdbb) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:38.568180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f32cd-c9e6-41d6-87b9-d1fb79544556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:38.569962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f32cd-c9e6-41d6-87b9-d1fb79544556 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:38.575936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 604/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:21:38 2022] GET /identity/v3/role_assignments?user.id=a6255cde29d24837a97eb0fe95a4bdbb&scope.project.id=7b06b05df20c422b8398d84609a4d9ce&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:48.409584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=85 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:48.573511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=29 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:33.519774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a384e-3e12-469b-9d4e-a9155748560b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:33.520444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a384e-3e12-469b-9d4e-a9155748560b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:33.520444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a384e-3e12-469b-9d4e-a9155748560b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:33.521657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 597/1201] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:22:33.527982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01ae39-7e38-464b-a5b9-5c400b296a8c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:33.528475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01ae39-7e38-464b-a5b9-5c400b296a8c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:33.528558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01ae39-7e38-464b-a5b9-5c400b296a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:33.548183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0a01ae39-7e38-464b-a5b9-5c400b296a8c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:22:33.549458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0a01ae39-7e38-464b-a5b9-5c400b296a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:33.643128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 605/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:22:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:22:33.670845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a384e-3e12-469b-9d4e-a9155748560b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:33.798797 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a384e-3e12-469b-9d4e-a9155748560b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:33.840353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:33.841110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:33.841408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:33.841707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:33.855719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:33.857354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:33.881077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:33.882235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:33.883803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:33.883803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:33.883803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:33.883803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:33.883803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 598/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:33.890088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01ae39-7e38-464b-a5b9-5c400b296a8c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:34.018030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01ae39-7e38-464b-a5b9-5c400b296a8c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:34.060904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:34.069841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155fe06-2d1b-4a2c-9c44-9baecfca2bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:34.071672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155fe06-2d1b-4a2c-9c44-9baecfca2bbc None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:34.071672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155fe06-2d1b-4a2c-9c44-9baecfca2bbc None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:34.071672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155fe06-2d1b-4a2c-9c44-9baecfca2bbc None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:34.072166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155fe06-2d1b-4a2c-9c44-9baecfca2bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:34.072567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155fe06-2d1b-4a2c-9c44-9baecfca2bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:34.073912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155fe06-2d1b-4a2c-9c44-9baecfca2bbc None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:34.091407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 606/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:34.093799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:34.155710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:34.214452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755a292-d5cd-4a5d-98da-d0d8937ecb15 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:34.255456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88c8e0-fd1a-4fe0-be6a-54a434de9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:34.256157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c8e0-fd1a-4fe0-be6a-54a434de9d42 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:34.256458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c8e0-fd1a-4fe0-be6a-54a434de9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:34.256802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c8e0-fd1a-4fe0-be6a-54a434de9d42 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:34.257560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88c8e0-fd1a-4fe0-be6a-54a434de9d42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:34.259317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88c8e0-fd1a-4fe0-be6a-54a434de9d42 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:34.283371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 599/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Jul 28 06:22:34 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:22:36.572313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8160de-68c1-4f2d-9913-423b04dabf7e None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:36.572991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8160de-68c1-4f2d-9913-423b04dabf7e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:36.572991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8160de-68c1-4f2d-9913-423b04dabf7e None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:36.574902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 607/1206] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:22:36.580842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11478b3a-8190-4864-8758-952b311f1f43 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:36.581305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11478b3a-8190-4864-8758-952b311f1f43 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:36.581409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11478b3a-8190-4864-8758-952b311f1f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:36.603850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-11478b3a-8190-4864-8758-952b311f1f43 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:22:36.605212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-11478b3a-8190-4864-8758-952b311f1f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:36.692158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 600/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:22:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:22:36.717663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8160de-68c1-4f2d-9913-423b04dabf7e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:36.836112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8160de-68c1-4f2d-9913-423b04dabf7e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:36.881592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:36.882281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:36.882535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:36.882809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:36.896806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:22:36.902523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:36.903762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:36.904711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 608/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:22:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:36.910577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11478b3a-8190-4864-8758-952b311f1f43 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:36.955685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:37.041082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11478b3a-8190-4864-8758-952b311f1f43 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:37.084165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:37.084811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:37.085073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:37.085347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:37.086064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:37.086411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:37.087799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:37.101516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 601/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:22:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:37.103546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:37.158300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:37.221245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223973b-b4a7-416a-9a0a-4838ce87d245 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:37.261732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:37.262563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:37.262964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:37.263330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:37.278357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:37.279848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:37.294916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:37.296132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:37.300777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:37.300777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:37.300777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:37.300777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:37.300777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 609/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:37.303296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:37.413757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:37.416948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7742c-10fa-48da-b95e-3f6f8ca664e0 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:37.454885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:37.455564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:37.455862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:37.456168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:37.456858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:37.457170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:37.458549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:37.471689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 602/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:37.478741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:37.590188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9507b-a61c-454a-9a6e-4a7853ac804e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:37.592200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:37.633012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:37.633671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:37.633944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:37.634216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:37.642772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:37.644333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:22:37.658117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:37.659309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:37.660324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 610/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:22:37.666113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:37.792376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5384e-df9f-45cb-ba1e-fabb348903bc None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:37.834168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:37.834806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:37.835100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:37.835364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:37.836176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:37.836472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:37.837912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:37.859178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 603/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Jul 28 06:22:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:37.865203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:37.990357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666990e-28d3-4989-9953-3bcf79fe0248 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:38.034270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:38.034983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:38.035315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:38.035571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:38.076877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:38.121472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:38.123058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:38.244815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 611/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:22:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:22:38.251076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:38.273195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:38.370097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262ea29-2a87-4626-87ee-b7c5289c50a5 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:38.408253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:38.409073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:38.409408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:38.409715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:38.422865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:38.424673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:38.441928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:38.443484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:38.449174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:38.449174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:38.449174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:38.449174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:38.449174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 604/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:38.449511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:38.515222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:38.557291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985877be-0d47-4c97-a98e-49606f85a24b None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:38.594084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:38.594790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:38.595126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:38.595468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:38.596257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:38.596676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:38.598184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:38.610058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 612/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:38.615889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:38.691593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:38.724084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdbe62-cb67-417b-be4e-b82fa08dc9a1 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:38.760828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:38.761474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:38.761756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:38.762028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:38.769648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:38.770987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:22:38.783002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:38.784270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:38.785434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:38.790261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:38.791294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 605/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:22:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:38.910713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e4668-add4-4027-a638-f54957915193 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:38.936832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:38.951965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29db50a-5c9a-4db0-8e4f-940040e34113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:38.952607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29db50a-5c9a-4db0-8e4f-940040e34113 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:38.952942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29db50a-5c9a-4db0-8e4f-940040e34113 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:38.953217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29db50a-5c9a-4db0-8e4f-940040e34113 None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:38.953972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29db50a-5c9a-4db0-8e4f-940040e34113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:38.954283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29db50a-5c9a-4db0-8e4f-940040e34113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:38.955768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29db50a-5c9a-4db0-8e4f-940040e34113 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:38.970154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 613/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:22:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:22:38.976470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:39.094354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1e3ac-fbcc-40ce-8afa-8918f0139562 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:39.127071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:39.134456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace98ce4-08b2-4a6c-9d63-3faf061f0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:39.135233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace98ce4-08b2-4a6c-9d63-3faf061f0b39 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:39.135657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace98ce4-08b2-4a6c-9d63-3faf061f0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:39.136019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace98ce4-08b2-4a6c-9d63-3faf061f0b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:39.136913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace98ce4-08b2-4a6c-9d63-3faf061f0b39 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:39.137333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace98ce4-08b2-4a6c-9d63-3faf061f0b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:39.139240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace98ce4-08b2-4a6c-9d63-3faf061f0b39 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:39.151669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 606/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:22:38 2022] GET /identity/v3/role_assignments?user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:41.304583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d685d-2e20-4e55-b171-d96f943d7f1f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:41.305136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d685d-2e20-4e55-b171-d96f943d7f1f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:41.305136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d685d-2e20-4e55-b171-d96f943d7f1f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:41.306622 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 614/1220] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:22:41.312276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad7d6-af33-4f3b-a84a-fa711f7a39ee None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:41.312739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad7d6-af33-4f3b-a84a-fa711f7a39ee None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:41.312923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad7d6-af33-4f3b-a84a-fa711f7a39ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:41.332856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-bd2ad7d6-af33-4f3b-a84a-fa711f7a39ee None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:22:41.334113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bd2ad7d6-af33-4f3b-a84a-fa711f7a39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:41.409984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 607/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:22:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:22:41.435465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d685d-2e20-4e55-b171-d96f943d7f1f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:41.545499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d685d-2e20-4e55-b171-d96f943d7f1f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:41.585347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:41.586039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:41.586325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:41.586759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] PATH_INFO: `/v3/roles/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:41.599052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:22:41.603970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:41.605039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:41.606247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 615/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:22:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:41.611410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ad7d6-af33-4f3b-a84a-fa711f7a39ee None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:41.710343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ad7d6-af33-4f3b-a84a-fa711f7a39ee None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:41.735922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:41.748189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:41.748919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:41.749271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:41.749565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:41.750417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] RBAC: Adding query filter params (name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:41.750744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:41.752430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:41.761690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 608/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:22:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:41.767875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:41.819924 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:41.884394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8b9ab-bfa7-42d6-adcf-5f8532539caa None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:41.918525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:41.919176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:41.919456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:41.919746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:41.931643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:41.933162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:41.947442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:41.948582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:41.950174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:41.950174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:41.950174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:41.950174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:41.950174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 616/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:41.954827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:42.067642 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d00fc-ecbd-44fe-88f7-4fc3c9d7a8bf None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:42.102934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:42.103566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:42.103885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:42.104162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:42.104851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:42.105154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:42.106534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:42.120729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 609/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:22:42.127123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:42.225455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:42.233721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e62f40-1284-4517-b11a-e9d28008f93e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:42.269655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:42.270405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:42.270712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:42.271018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:42.279809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:42.281425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:22:42.293648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:42.294805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:42.295847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 617/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:42.301033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:42.349729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:42.410210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab251de-4229-4453-b6ff-97a36739fc62 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:42.449641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:42.450373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:42.450702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:42.450983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:42.451817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:42.452133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:42.453807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:42.474871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 610/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Jul 28 06:22:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:42.481946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:42.590245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab386b-1ef4-4a47-be71-b02f4a49b187 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:42.624815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:42.625456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:42.625733 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:42.626042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:42.637280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:42.638869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:42.655234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:42.656302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:42.657209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:42.657209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:42.657209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:42.657209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:42.657209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 618/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:22:42.662750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:42.777568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33fc4d-37ac-4990-a392-f457b38ad6f6 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:42.780444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:42.824812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:42.825453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:42.825738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:42.826016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:42.826709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:42.827018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:42.828493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:42.841965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 611/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:42.848423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:42.858922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:42.959630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844c9a-4a07-4cd1-8a5c-49de125ac62e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:42.996058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:42.996701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:42.997030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:42.997306 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:43.003996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:43.005453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:22:43.016603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:43.017588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:43.019075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 619/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:43.023910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:43.142064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd7696-2a44-4321-9e0f-6f94c90d6a75 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:43.179410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a47b9-237e-49fa-b4c8-30ecf639102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:43.180108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a47b9-237e-49fa-b4c8-30ecf639102c None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:43.180431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a47b9-237e-49fa-b4c8-30ecf639102c None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:43.180616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a47b9-237e-49fa-b4c8-30ecf639102c None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:43.181370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a47b9-237e-49fa-b4c8-30ecf639102c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:43.181677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a47b9-237e-49fa-b4c8-30ecf639102c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:43.183156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a47b9-237e-49fa-b4c8-30ecf639102c None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:43.196782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 612/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:22:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:43.202710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:43.279815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:43.318242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f10f9-6ea4-4708-ac76-4208c73acc41 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:43.353526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24338f9-923e-48b0-97af-7449314d401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:43.354351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24338f9-923e-48b0-97af-7449314d401e None admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:43.354633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24338f9-923e-48b0-97af-7449314d401e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:43.354932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24338f9-923e-48b0-97af-7449314d401e None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/c2fd4c5e6d864ccd864a0114f5f5ff4e/roles/2ceab442c0cc49b5ad07767f77f687fe` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:43.371461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24338f9-923e-48b0-97af-7449314d401e None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=c2fd4c5e6d864ccd864a0114f5f5ff4e, role_id=2ceab442c0cc49b5ad07767f77f687fe)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:43.373116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24338f9-923e-48b0-97af-7449314d401e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:43.388261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 620/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:22:43 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/c2fd4c5e6d864ccd864a0114f5f5ff4e/roles/2ceab442c0cc49b5ad07767f77f687fe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:22:45.521754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05c02-01d2-4264-bf7c-de4e9e7a43ee None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:45.522343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05c02-01d2-4264-bf7c-de4e9e7a43ee None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:45.522343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05c02-01d2-4264-bf7c-de4e9e7a43ee None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:45.523679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 613/1233] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:22:45.529178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892ef5f-f656-452f-85ad-c1384fb3541e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:45.529781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892ef5f-f656-452f-85ad-c1384fb3541e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:45.529781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892ef5f-f656-452f-85ad-c1384fb3541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:45.548620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5892ef5f-f656-452f-85ad-c1384fb3541e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:22:45.550012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5892ef5f-f656-452f-85ad-c1384fb3541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:45.621815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 621/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:22:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:22:45.645432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05c02-01d2-4264-bf7c-de4e9e7a43ee None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:45.672459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:45.753324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05c02-01d2-4264-bf7c-de4e9e7a43ee None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:45.789093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:45.789760 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:45.790139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:45.790513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] PATH_INFO: `/v3/roles/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:45.804292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:22:45.809627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:45.810822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:45.811867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 614/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Jul 28 06:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:45.817764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892ef5f-f656-452f-85ad-c1384fb3541e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:45.870627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:45.927018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892ef5f-f656-452f-85ad-c1384fb3541e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:45.966510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:45.967155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:45.967492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:45.967874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:45.968803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] RBAC: Adding query filter params (name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:45.969183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:45.970606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:45.980684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 622/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Jul 28 06:22:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:45.987342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:46.084367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:46.101167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6029d-5445-46e2-b707-08d9bae6497f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:46.137761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:46.138525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:46.138811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:46.139107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:46.149454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:46.150983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:46.165665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:46.172130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:46.173087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:46.173087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:46.173087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:46.173087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:46.173087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 615/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:22:46.173377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:46.287147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17343e1-aca1-42a2-a37d-c9599ac8c142 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:46.296390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:46.322804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:46.323455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:46.323768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:46.324044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:46.324721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:46.325040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:46.326387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:46.342567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 623/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:46.343875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:46.448974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e97aea-10db-4f50-9c0a-fe5fdda32d71 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:46.482765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:46.483415 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:46.483752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:46.484031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:46.486867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:46.492094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:46.493725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:22:46.505605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:46.506785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:46.507768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 616/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:22:46.512985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:46.626326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad381204-3e55-454e-8f78-c3480eb05969 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:46.660750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:46.661385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:46.661670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:46.661977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:46.662756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:46.663058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:46.664491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:46.683410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 624/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Jul 28 06:22:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:46.690034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:46.809639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bc1c1-e305-45ed-8f12-a6aa982bc743 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:46.846630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:46.847256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:46.847583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:46.847886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:46.910078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:46.917650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:46.919110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:47.034564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 617/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:22:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:22:47.041139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:47.071708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:47.155711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b4f15-4958-48be-b96a-09d187494484 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:47.194433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:47.195100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:47.195380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:47.195677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:47.206433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:47.208116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:47.224879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:47.225993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:47.227125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:47.227125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:47.227125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:47.227125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:47.231164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 625/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:22:47.232191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:47.340422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:47.348566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e538f1-7f19-4e2b-bccd-306ad13a31ce None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:47.391781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:47.392428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:47.392716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:47.393101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:47.393884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:47.394188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:47.395579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:47.408209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 618/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:22:47.414700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:47.504208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:47.528544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002015d8-8b80-4c23-afb8-baf8799ebde7 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:47.563662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:47.564550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:47.564909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:47.565187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:47.572574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:47.574307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:22:47.586974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:47.588073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:47.589168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 626/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:22:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:47.594406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:47.709964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5784f0-7895-4288-b309-de7b9d9cc97e None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:47.752030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eb16f-9c62-4faa-b28e-5913d4835b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:47.752766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eb16f-9c62-4faa-b28e-5913d4835b00 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:47.753052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eb16f-9c62-4faa-b28e-5913d4835b00 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:47.753353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eb16f-9c62-4faa-b28e-5913d4835b00 None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:47.754158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eb16f-9c62-4faa-b28e-5913d4835b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:47.754570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eb16f-9c62-4faa-b28e-5913d4835b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:47.756050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eb16f-9c62-4faa-b28e-5913d4835b00 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:47.769758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 619/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:22:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:47.777932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:47.891591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f29f0-9282-4600-8da9-21e5d45842ec None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:47.930954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f11b98-06dd-441d-9f22-86a50693fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:47.931723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f11b98-06dd-441d-9f22-86a50693fb29 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:47.932007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f11b98-06dd-441d-9f22-86a50693fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:47.932303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f11b98-06dd-441d-9f22-86a50693fb29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:47.933260 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f11b98-06dd-441d-9f22-86a50693fb29 None admin] RBAC: Adding query filter params (role.id=2ceab442c0cc49b5ad07767f77f687fe, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:47.933571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f11b98-06dd-441d-9f22-86a50693fb29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:47.935160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f11b98-06dd-441d-9f22-86a50693fb29 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:47.942498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 627/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:22:47 2022] GET /identity/v3/role_assignments?user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=2ceab442c0cc49b5ad07767f77f687fe => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:50.030395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b443-4703-4b1e-b970-263f5df5b28d None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:50.030992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b443-4703-4b1e-b970-263f5df5b28d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:50.030992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b443-4703-4b1e-b970-263f5df5b28d None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:50.032402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 620/1247] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:22:50.037966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418f40-ac0e-44b2-9606-3f2582100201 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:50.038422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418f40-ac0e-44b2-9606-3f2582100201 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:50.038529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418f40-ac0e-44b2-9606-3f2582100201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:50.045400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:50.059159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-8e418f40-ac0e-44b2-9606-3f2582100201 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:22:50.060462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8e418f40-ac0e-44b2-9606-3f2582100201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:50.134301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 628/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:22:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:22:50.157949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b443-4703-4b1e-b970-263f5df5b28d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:50.176461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:50.275451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b443-4703-4b1e-b970-263f5df5b28d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:50.316615 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:50.317674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:50.318016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:50.318312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:50.331066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:22:50.336012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:50.337066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:50.337918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 621/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:22:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:22:50.343796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e418f40-ac0e-44b2-9606-3f2582100201 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:50.459538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e418f40-ac0e-44b2-9606-3f2582100201 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:50.493854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:50.499912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:50.500552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:50.500831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:50.501103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:50.501816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:50.502118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:50.503544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:50.512841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 629/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:22:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:50.518927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:50.609288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:50.638391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30994f4-4b94-463e-bd3c-84272cb9a776 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:50.678565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:50.679224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:50.679506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:50.679818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:50.691012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:50.692982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:50.709357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:50.710483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:50.711497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:50.711497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:50.711497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:50.711497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:50.711497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 622/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:50.719114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:50.845794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e677e-bb23-4a48-bcb2-55e4e0ade86d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:50.885978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:50.886539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:50.886822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:50.887091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:50.887806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:50.888124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:50.889474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:50.901899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 630/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:50.907707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:51.016020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42804a2a-080f-4dc0-96a5-7f1e39a0e8da None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:51.048656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:51.058216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:51.059068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:51.059376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:51.059700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] PATH_INFO: `/v3/users/placement` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:51.069195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:51.070854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:22:51.083181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:51.084485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:51.085653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 623/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:51.090528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:51.150165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:51.205409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2e34d-eeab-4142-9b17-04d42c47f535 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:51.242635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:51.243413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:51.243802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:51.244056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:51.244849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:51.245186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:51.246796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:51.265405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 631/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Jul 28 06:22:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:51.271653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:51.385787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f6f3a-2d8d-40fd-b417-8b858f8eb02f None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:51.422926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:51.423583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:51.423908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:51.424204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:51.491384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:51.504502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:51.506213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:51.616843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 624/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:22:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 06:22:51.618183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:51.726289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8433a-962c-4b71-8bc1-10bb90ce34f1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:51.740240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:51.765957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:51.766686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:51.767212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:51.767565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:51.786160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:51.788641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:51.812856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:51.813997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:51.814986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:51.814986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:51.814986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:51.814986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:51.814986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 632/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:51.821154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:51.923638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:51.937715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6fc79-948e-4419-9044-9bc8f4d62deb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:51.979481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:51.980163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:51.980449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:51.980721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:51.981420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:51.981720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:51.983107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:51.995049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 625/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:52.001106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:52.112374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe5188-5b6d-4537-bf1e-2f995cbdd4b8 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:52.148064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:52.148771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:52.149052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:52.149325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:52.156192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:52.158040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:22:52.172417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:52.173541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:52.179675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 633/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:52.180448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:52.289138 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8922-36ec-463d-8fbd-c3dd032b79cc None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:52.324165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ace575-13d3-4ff0-b118-c6ad1cb5558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:52.324795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ace575-13d3-4ff0-b118-c6ad1cb5558a None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:52.325073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ace575-13d3-4ff0-b118-c6ad1cb5558a None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:52.325348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ace575-13d3-4ff0-b118-c6ad1cb5558a None admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:52.326092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ace575-13d3-4ff0-b118-c6ad1cb5558a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:52.326397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ace575-13d3-4ff0-b118-c6ad1cb5558a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:52.327894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ace575-13d3-4ff0-b118-c6ad1cb5558a None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:52.340221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 626/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:52.346787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:52.373848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:52.453781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa4d7-3771-4456-b19b-00c464cb5974 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:52.491292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514a4f0-4394-46a4-ba2b-cc10cf85ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:52.491972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514a4f0-4394-46a4-ba2b-cc10cf85ee7b None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:52.492247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514a4f0-4394-46a4-ba2b-cc10cf85ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:52.492520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514a4f0-4394-46a4-ba2b-cc10cf85ee7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:52.493316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514a4f0-4394-46a4-ba2b-cc10cf85ee7b None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:52.493623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514a4f0-4394-46a4-ba2b-cc10cf85ee7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:52.495070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514a4f0-4394-46a4-ba2b-cc10cf85ee7b None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:52.501011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 634/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:22:52 2022] GET /identity/v3/role_assignments?user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=af3b62eec1004adc904a4c278710faee => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:54.494506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14dfb-c0f3-47fa-90b6-965bda009347 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:54.495311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14dfb-c0f3-47fa-90b6-965bda009347 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:54.495460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14dfb-c0f3-47fa-90b6-965bda009347 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:54.497643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 627/1261] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:22:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:22:54.503273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88222-2c5e-4866-ac9b-8a8e0034addd None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:54.503705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88222-2c5e-4866-ac9b-8a8e0034addd None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:54.503821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88222-2c5e-4866-ac9b-8a8e0034addd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:54.524526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f0e88222-2c5e-4866-ac9b-8a8e0034addd None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:22:54.525718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f0e88222-2c5e-4866-ac9b-8a8e0034addd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:54.598101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 635/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:22:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:22:54.631691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14dfb-c0f3-47fa-90b6-965bda009347 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:54.646765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:54.745632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14dfb-c0f3-47fa-90b6-965bda009347 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:54.788403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:54.789462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:54.789932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:54.790140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:54.806422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:22:54.812548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:54.813893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:54.815190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 628/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:22:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:54.821155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e88222-2c5e-4866-ac9b-8a8e0034addd None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:54.840407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:54.925071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e88222-2c5e-4866-ac9b-8a8e0034addd None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:54.960682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:54.961303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:54.961583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:54.961859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:54.962570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:54.962878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:54.964290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:54.972542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 636/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:54.978446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:55.048169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:55.082741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0f6d-b1c7-4802-bae4-3ded03b85a41 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:55.118505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:55.119131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:55.119406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:55.119718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:55.129935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:55.131398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:55.145936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:55.146952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:55.148061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:55.148061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:55.148061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:55.148061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:55.148061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 629/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:55.153607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:55.243422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:55.268391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55f1b-cbe3-4dc1-b613-48e3ac382b47 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:55.304802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:55.305364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:55.305642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:55.305931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:55.306628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:55.306925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:55.308342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:55.320658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 637/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:55.327267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:55.478567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1f83-90a0-41a5-a095-421d90d764b7 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:55.502918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:55.519890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:55.520531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:55.520808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:55.521074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:55.528607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:55.530043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:22:55.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:55.542273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:55.543302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 630/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:55.548448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:55.652391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119d20-cdf2-40f6-903b-cd64e966e8ba None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:55.697285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:55.697915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:55.698213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:55.698470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:55.699253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:55.699562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:55.701000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:55.709913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:55.719480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 638/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Jul 28 06:22:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:55.725517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:55.838232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5e33c-606a-44b6-9d23-e52a9dd88a80 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:55.872881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:55.873815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:55.874184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:55.874554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:55.887800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:55.889265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:55.904243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:55.905259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:55.911330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:55.911330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:55.911330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:55.911330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:55.911330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 631/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:55.911727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:56.029857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd8750-fa0b-4875-aa2c-ef0019a87293 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:56.066943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:56.067570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:56.067887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:56.068159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:56.068839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:56.069130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:56.070503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:56.083142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 639/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:56.089218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:56.123948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:56.198223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbe9df-06be-4898-b7f1-213d3a7bc099 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:56.245892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:56.246546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:56.246827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:56.247100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:56.253990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:56.255443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:22:56.267136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:56.268197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:22:56.269302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 632/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:56.276653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:56.338419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:56.381117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07f8d-f5e7-47ea-b512-3400bcd8f3b5 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:56.415632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c6fd8-d8dd-4640-a243-38f62145df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:56.416261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c6fd8-d8dd-4640-a243-38f62145df3e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:56.416539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c6fd8-d8dd-4640-a243-38f62145df3e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:56.416810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c6fd8-d8dd-4640-a243-38f62145df3e None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:56.417552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c6fd8-d8dd-4640-a243-38f62145df3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:56.417858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c6fd8-d8dd-4640-a243-38f62145df3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:56.419273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c6fd8-d8dd-4640-a243-38f62145df3e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:56.431244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 640/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:22:56.438103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:56.538771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:56.548129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065132f-d9de-4dd8-9fe7-292409f60969 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:56.583983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4ad8d-e154-4d8a-a0b2-40845987b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:56.584636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ad8d-e154-4d8a-a0b2-40845987b9e0 None admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:56.584916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ad8d-e154-4d8a-a0b2-40845987b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:56.585194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ad8d-e154-4d8a-a0b2-40845987b9e0 None admin] PATH_INFO: `/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/c2fd4c5e6d864ccd864a0114f5f5ff4e/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:56.587237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4ad8d-e154-4d8a-a0b2-40845987b9e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e0b4663bd4b9a9f79e2bd9909935f, user_id=c2fd4c5e6d864ccd864a0114f5f5ff4e, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:56.588814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4ad8d-e154-4d8a-a0b2-40845987b9e0 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:56.605627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 633/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Jul 28 06:22:56 2022] PUT /identity/v3/projects/0b9e0b4663bd4b9a9f79e2bd9909935f/users/c2fd4c5e6d864ccd864a0114f5f5ff4e/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:22:58.570513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d73d-e3a1-4714-b8f6-9ee2a83eb226 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:58.571097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d73d-e3a1-4714-b8f6-9ee2a83eb226 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:58.571097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d73d-e3a1-4714-b8f6-9ee2a83eb226 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:58.573230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 641/1274] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:22:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:22:58.581770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec293b-f2c5-46f8-9669-012fa288012d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:58.582145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec293b-f2c5-46f8-9669-012fa288012d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:58.582326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec293b-f2c5-46f8-9669-012fa288012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:58.602547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-80ec293b-f2c5-46f8-9669-012fa288012d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:22:58.603782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-80ec293b-f2c5-46f8-9669-012fa288012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:58.676238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 634/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:22:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:22:58.711315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d73d-e3a1-4714-b8f6-9ee2a83eb226 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:58.837592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d73d-e3a1-4714-b8f6-9ee2a83eb226 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:58.855083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:58.872420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:58.873060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:58.873332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:58.873605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:58.884190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:22:58.889109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:58.890199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:58.891048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 642/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Jul 28 06:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:58.896658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec293b-f2c5-46f8-9669-012fa288012d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:58.981177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:59.000140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec293b-f2c5-46f8-9669-012fa288012d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:59.035851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:59.036578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:59.036858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:59.037135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:59.037854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] RBAC: Adding query filter params (name=admin) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:59.038158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:59.039546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:59.048263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 635/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Jul 28 06:22:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:22:59.054187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:59.177127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1de8b-e530-402c-b391-4f814aeeb03e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:59.212233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:59.212860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:59.213141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:59.213411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:59.223769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:59.225209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:22:59.239923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:59.240985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:59.241914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:22:59.241914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:22:59.241914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:22:59.241914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:59.241914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 643/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:59.247713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:59.352166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c78b3a-7145-4e1d-84b0-17f5606b837d None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:59.386650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:59.387257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:59.387532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:59.387834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:59.388508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:59.388807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:59.390175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:59.402009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 636/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:22:59.408050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:59.447915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:59.529795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ccb7-b198-497a-a73b-80d8c6ea705c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:59.565058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:59.565703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:59.566045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:59.566678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:59.574611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:59.576090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:22:59.587445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:22:59.588448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:22:59.590326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 644/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:22:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:22:59.597894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:59.602020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:59.712846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd08878-00f2-42a0-909b-9744793d4adb None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:59.748991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:59.749606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:59.749884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:59.750157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:59.750942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:22:59.751248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:59.752725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:59.771434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 637/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Jul 28 06:22:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:22:59.777586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:59.872285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:59.882125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c4aa-9377-4fdb-a53d-e9ac42aa9c4c None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:59.916806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:59.917421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:59.917697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:59.917976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:59.987512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:59.989003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:00.081077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:00.099492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 645/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Jul 28 06:22:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:23:00.109178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:00.177900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:00.217317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc8000-51b0-443e-b7c0-d6c49c6527af None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:00.255460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:00.256052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:00.256329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:00.256598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:00.267976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:00.269461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:23:00.285232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:23:00.286238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:23:00.287350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:23:00.287350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:23:00.287350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:23:00.287350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:23:00.291121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 638/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:23:00.292194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:00.398902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10c81-732b-42e7-a3ce-e5f9e9737107 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:00.434676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:00.435302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:00.435584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:00.435895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:00.436588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:00.436894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:00.438272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:00.450176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 646/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Jul 28 06:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:00.456253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:00.574041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88106-df36-47fc-a5c7-f2f162a42182 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:00.589402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:00.612872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:00.613532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:00.613766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:00.614036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:00.620999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:00.622441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:23:00.634305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application with Lock( Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:23:00.635324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: ERROR keystone.server.flask.application Jul 28 06:23:00.636586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 639/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Jul 28 06:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:23:00.641532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:00.697054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:00.750947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90dd0b-8636-4a7d-a7cd-7c79379c3f8d None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:00.793604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a9e1-9531-4178-9789-ac019cf2d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:00.794274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a9e1-9531-4178-9789-ac019cf2d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:00.794599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a9e1-9531-4178-9789-ac019cf2d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:00.795067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a9e1-9531-4178-9789-ac019cf2d7c1 None admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:00.795988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2a9e1-9531-4178-9789-ac019cf2d7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:00.796333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2a9e1-9531-4178-9789-ac019cf2d7c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:00.797925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2a9e1-9531-4178-9789-ac019cf2d7c1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:00.812244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 647/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Jul 28 06:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:00.818843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:00.937661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4ee62-333a-4d1b-a2fd-809bfaafba21 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:00.973374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17187-50af-4b62-bbed-06e9517bf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:00.973981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17187-50af-4b62-bbed-06e9517bf134 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:00.974263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17187-50af-4b62-bbed-06e9517bf134 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:00.974533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17187-50af-4b62-bbed-06e9517bf134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:00.975317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17187-50af-4b62-bbed-06e9517bf134 None admin] RBAC: Adding query filter params (role.id=af3b62eec1004adc904a4c278710faee, scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f, user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:00.975656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17187-50af-4b62-bbed-06e9517bf134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:00.977106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17187-50af-4b62-bbed-06e9517bf134 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:00.983079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 640/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Jul 28 06:23:00 2022] GET /identity/v3/role_assignments?user.id=c2fd4c5e6d864ccd864a0114f5f5ff4e&scope.project.id=0b9e0b4663bd4b9a9f79e2bd9909935f&role.id=af3b62eec1004adc904a4c278710faee => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:02.999491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0254-a71b-47a3-a018-51b154e9da84 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:03.000407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0254-a71b-47a3-a018-51b154e9da84 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:03.000407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0254-a71b-47a3-a018-51b154e9da84 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:03.003021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 648/1288] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:23:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:23:03.010300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad9f0-b8ed-4ebd-bbc0-153a5d42ce70 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:03.011131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad9f0-b8ed-4ebd-bbc0-153a5d42ce70 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:03.012041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad9f0-b8ed-4ebd-bbc0-153a5d42ce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:03.037380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-818ad9f0-b8ed-4ebd-bbc0-153a5d42ce70 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:23:03.039485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-818ad9f0-b8ed-4ebd-bbc0-153a5d42ce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:03.073582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:03.111524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 641/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:23:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:23:03.133334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f0254-a71b-47a3-a018-51b154e9da84 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:03.241045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f0254-a71b-47a3-a018-51b154e9da84 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:03.251667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:03.289396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:03.290039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:03.290316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:03.290583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:03.291193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:03.292592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:23:03.301626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:23:03.302790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:03.303717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 649/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:23:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:23:03.309194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad9f0-b8ed-4ebd-bbc0-153a5d42ce70 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:03.423110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad9f0-b8ed-4ebd-bbc0-153a5d42ce70 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:03.468882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0d614-95dd-4cc9-9e1d-434d799f1ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:03.469505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0d614-95dd-4cc9-9e1d-434d799f1ec3 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:03.469784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0d614-95dd-4cc9-9e1d-434d799f1ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:03.470057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0d614-95dd-4cc9-9e1d-434d799f1ec3 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:03.470734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0d614-95dd-4cc9-9e1d-434d799f1ec3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:03.471042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0d614-95dd-4cc9-9e1d-434d799f1ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:03.472507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0d614-95dd-4cc9-9e1d-434d799f1ec3 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:03.477612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 642/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Jul 28 06:23:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:03.483874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:03.594930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ae8db-37f0-4cee-bd08-70a849cf1088 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:03.641952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a99dc5-b613-48c7-bb1f-2e7d5e04757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:03.642856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a99dc5-b613-48c7-bb1f-2e7d5e04757a None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:03.643108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a99dc5-b613-48c7-bb1f-2e7d5e04757a None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:03.643393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a99dc5-b613-48c7-bb1f-2e7d5e04757a None admin] PATH_INFO: `/v3/services` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:03.644451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a99dc5-b613-48c7-bb1f-2e7d5e04757a None admin] RBAC: Adding query filter params (type=placement) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:03.644758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a99dc5-b613-48c7-bb1f-2e7d5e04757a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:03.646127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a99dc5-b613-48c7-bb1f-2e7d5e04757a None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:03.650962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 650/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Jul 28 06:23:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:05.616981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4965e7-7ff8-4829-a6e2-ab1850739621 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:05.617987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4965e7-7ff8-4829-a6e2-ab1850739621 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:05.617987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4965e7-7ff8-4829-a6e2-ab1850739621 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:05.620046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 643/1293] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:23:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:23:05.627779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff66c1-93ea-407c-922d-0167f99af35e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:05.628349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff66c1-93ea-407c-922d-0167f99af35e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:05.628495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff66c1-93ea-407c-922d-0167f99af35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:05.647539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-feff66c1-93ea-407c-922d-0167f99af35e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:23:05.648746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-feff66c1-93ea-407c-922d-0167f99af35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:05.679005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:05.718684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 651/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:23:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:23:05.741904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4965e7-7ff8-4829-a6e2-ab1850739621 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:05.786137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:05.877485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4965e7-7ff8-4829-a6e2-ab1850739621 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:05.913263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843b292-2075-46b0-bfd6-b98f62790081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:05.913878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843b292-2075-46b0-bfd6-b98f62790081 None admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:05.914152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843b292-2075-46b0-bfd6-b98f62790081 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:05.914430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843b292-2075-46b0-bfd6-b98f62790081 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:05.915113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843b292-2075-46b0-bfd6-b98f62790081 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:05.916654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843b292-2075-46b0-bfd6-b98f62790081 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:05.937650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 644/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Jul 28 06:23:05 2022] POST /identity/v3/services => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:23:07.922928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b211ca-e94e-4484-9006-9be6f0f7fbef None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:07.923529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b211ca-e94e-4484-9006-9be6f0f7fbef None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:07.923529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b211ca-e94e-4484-9006-9be6f0f7fbef None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:07.925586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 652/1296] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:23:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:23:07.934016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9561f8-42ab-4f9f-bf60-5dda60bbb12f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:07.934431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9561f8-42ab-4f9f-bf60-5dda60bbb12f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:07.934640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9561f8-42ab-4f9f-bf60-5dda60bbb12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:07.956067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-3d9561f8-42ab-4f9f-bf60-5dda60bbb12f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:23:07.957285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3d9561f8-42ab-4f9f-bf60-5dda60bbb12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:08.034353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 645/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:23:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:23:08.059534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b211ca-e94e-4484-9006-9be6f0f7fbef None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:08.188095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b211ca-e94e-4484-9006-9be6f0f7fbef None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:08.224101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:08.224748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:08.225031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:08.225305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] PATH_INFO: `/v3/services/placement` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:08.225928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:08.227303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:23:08.236579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:23:08.237854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:08.238968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 653/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:23:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:23:08.244295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9561f8-42ab-4f9f-bf60-5dda60bbb12f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:08.268531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:08.383748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9561f8-42ab-4f9f-bf60-5dda60bbb12f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:08.424144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:08.424877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:08.425159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:08.425472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:08.426170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:08.426482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:08.427941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:08.434191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 646/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Jul 28 06:23:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:08.444385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:08.477820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:08.565464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c3c2-276c-4889-b9c7-18c0003b246e None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:08.600858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a0f0f-8435-4a2c-848b-f5ebbbb60fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:08.601482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a0f0f-8435-4a2c-848b-f5ebbbb60fe3 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:08.601766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a0f0f-8435-4a2c-848b-f5ebbbb60fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:08.602040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a0f0f-8435-4a2c-848b-f5ebbbb60fe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:08.602796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a0f0f-8435-4a2c-848b-f5ebbbb60fe3 None admin] RBAC: Adding query filter params (interface=public, service_id=c8ce0492c2d140419a6d89995449f2e8, region_id=RegionOne) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:08.603102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a0f0f-8435-4a2c-848b-f5ebbbb60fe3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:08.604526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a0f0f-8435-4a2c-848b-f5ebbbb60fe3 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:08.609772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 654/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Jul 28 06:23:08 2022] GET /identity/v3/endpoints?service_id=c8ce0492c2d140419a6d89995449f2e8&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:08.619033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:08.710349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:08.729127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5518-b82d-4bfc-b484-bc9973ff8523 None admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:08.766908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32160-b564-4e32-82c8-8fcbbab4ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:08.767472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32160-b564-4e32-82c8-8fcbbab4ac53 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:08.767842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32160-b564-4e32-82c8-8fcbbab4ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:08.768087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32160-b564-4e32-82c8-8fcbbab4ac53 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:08.768808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32160-b564-4e32-82c8-8fcbbab4ac53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:08.770704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32160-b564-4e32-82c8-8fcbbab4ac53 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:08.786323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 647/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Jul 28 06:23:08 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:23:10.770269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5833ca-01fb-412e-a7a2-329ef539abab None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:10.771172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5833ca-01fb-412e-a7a2-329ef539abab None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:10.771172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5833ca-01fb-412e-a7a2-329ef539abab None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:10.773324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 655/1302] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:23:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:23:10.778646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eccad-5f60-4bb6-aa43-c0c2e57cd206 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:10.779070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eccad-5f60-4bb6-aa43-c0c2e57cd206 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:10.779198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eccad-5f60-4bb6-aa43-c0c2e57cd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:10.798692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-241eccad-5f60-4bb6-aa43-c0c2e57cd206 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:23:10.799922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-241eccad-5f60-4bb6-aa43-c0c2e57cd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:10.869778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 648/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:23:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:23:10.892855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5833ca-01fb-412e-a7a2-329ef539abab None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:10.996460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:11.006638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5833ca-01fb-412e-a7a2-329ef539abab None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:11.050239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:11.051198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:11.051564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:11.051980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:11.052925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:11.055067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:23:11.068138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:23:11.069251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application with Lock( Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:23:11.070238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: ERROR keystone.server.flask.application Jul 28 06:23:11.071811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 656/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Jul 28 06:23:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:23:11.075514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eccad-5f60-4bb6-aa43-c0c2e57cd206 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:11.164111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:11.189634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eccad-5f60-4bb6-aa43-c0c2e57cd206 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:11.224520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565de02-0abc-4cbf-9033-fdaed3c885a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:11.225132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565de02-0abc-4cbf-9033-fdaed3c885a2 None admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:11.225397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565de02-0abc-4cbf-9033-fdaed3c885a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:11.225688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565de02-0abc-4cbf-9033-fdaed3c885a2 None admin] PATH_INFO: `/v3/services` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:11.226356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565de02-0abc-4cbf-9033-fdaed3c885a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:23:11.226659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565de02-0abc-4cbf-9033-fdaed3c885a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:11.228076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565de02-0abc-4cbf-9033-fdaed3c885a2 None admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:11.233388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 649/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Jul 28 06:23:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:23:11.240925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:11.349601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53172c4-8caa-48da-82e2-a4909c6885b1 None admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:11.384120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d74b3a-7d99-4680-a354-113f73f3576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:11.384725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d74b3a-7d99-4680-a354-113f73f3576c None admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:11.385005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d74b3a-7d99-4680-a354-113f73f3576c None admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:11.385276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d74b3a-7d99-4680-a354-113f73f3576c None admin] PATH_INFO: `/v3/endpoints` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:11.385964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d74b3a-7d99-4680-a354-113f73f3576c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:11.387315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d74b3a-7d99-4680-a354-113f73f3576c None admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:11.414368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 657/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:23:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:23:21.230379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=30 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:21.406965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:14.304099 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd9ce0-4659-4de4-9a75-6d41f658d520 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:14.304701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd9ce0-4659-4de4-9a75-6d41f658d520 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:14.304701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd9ce0-4659-4de4-9a75-6d41f658d520 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:14.311225 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd6ed9-7c76-4e1d-bb71-ac859a9da49b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:14.311684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd6ed9-7c76-4e1d-bb71-ac859a9da49b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:14.311842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd6ed9-7c76-4e1d-bb71-ac859a9da49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:14.317160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 650/1307] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:14.448997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-94cd6ed9-7c76-4e1d-bb71-ac859a9da49b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:14.451592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-94cd6ed9-7c76-4e1d-bb71-ac859a9da49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:14.620116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 658/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:24:14.671075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6654ef-4c6d-4944-b0b7-e3a7318ac1e0 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:14.671642 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6654ef-4c6d-4944-b0b7-e3a7318ac1e0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:14.672031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6654ef-4c6d-4944-b0b7-e3a7318ac1e0 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:14.673879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 651/1309] 10.222.0.58 () {54 vars in 965 bytes} [Thu Jul 28 06:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:14.680935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7f85-fdb2-4039-b413-2d79dfe93a1c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:14.681294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7f85-fdb2-4039-b413-2d79dfe93a1c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:14.681482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7f85-fdb2-4039-b413-2d79dfe93a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:14.769081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3f8a7f85-fdb2-4039-b413-2d79dfe93a1c None None] MFA Rules not processed for user `c206251915e74dba98b9422cf2f026d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:14.770199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3f8a7f85-fdb2-4039-b413-2d79dfe93a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:14.792401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:14.853051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 659/1310] 10.222.0.58 () {58 vars in 1062 bytes} [Thu Jul 28 06:24:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:24:14.862269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6654ef-4c6d-4944-b0b7-e3a7318ac1e0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:14.864032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-be6654ef-4c6d-4944-b0b7-e3a7318ac1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:14.985383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6654ef-4c6d-4944-b0b7-e3a7318ac1e0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:15.071042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cbf0e-9a28-4ba0-8576-bcbdd0efa0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:15.071707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cbf0e-9a28-4ba0-8576-bcbdd0efa0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:15.071985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cbf0e-9a28-4ba0-8576-bcbdd0efa0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:15.072256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cbf0e-9a28-4ba0-8576-bcbdd0efa0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:15.074012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ac4cbf0e-9a28-4ba0-8576-bcbdd0efa0a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:15.131559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:15.207590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cbf0e-9a28-4ba0-8576-bcbdd0efa0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:15.209120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cbf0e-9a28-4ba0-8576-bcbdd0efa0a9 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:15.234678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 652/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:17.477191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215581-f082-4a61-80eb-9e4c0783ce42 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:17.477765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215581-f082-4a61-80eb-9e4c0783ce42 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:17.477765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215581-f082-4a61-80eb-9e4c0783ce42 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:17.479169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 660/1312] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:17.485213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fede-f3a1-4eb1-9f51-1170e3d5798e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:17.485744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fede-f3a1-4eb1-9f51-1170e3d5798e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:17.485744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fede-f3a1-4eb1-9f51-1170e3d5798e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:17.569191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a511fede-f3a1-4eb1-9f51-1170e3d5798e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:17.570436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a511fede-f3a1-4eb1-9f51-1170e3d5798e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:17.682138 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 653/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:17.732435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc133-9aec-4eea-a110-820908849fd8 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:17.732794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc133-9aec-4eea-a110-820908849fd8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:17.732998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc133-9aec-4eea-a110-820908849fd8 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:17.734562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 661/1314] 10.222.0.58 () {54 vars in 965 bytes} [Thu Jul 28 06:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:17.740275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ecb0-2045-42c3-bd0a-d7f460988744 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:17.740658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ecb0-2045-42c3-bd0a-d7f460988744 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:17.741075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ecb0-2045-42c3-bd0a-d7f460988744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:17.753051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:17.821379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d0b8ecb0-2045-42c3-bd0a-d7f460988744 None None] MFA Rules not processed for user `c206251915e74dba98b9422cf2f026d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:17.822735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d0b8ecb0-2045-42c3-bd0a-d7f460988744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:17.903271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 654/1315] 10.222.0.58 () {58 vars in 1062 bytes} [Thu Jul 28 06:24:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:17.912827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc133-9aec-4eea-a110-820908849fd8 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:17.914357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3bccc133-9aec-4eea-a110-820908849fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:18.023677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc133-9aec-4eea-a110-820908849fd8 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:18.098941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:18.101895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f86eab-4a7b-4cd2-a813-60caa97b161b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:18.102554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f86eab-4a7b-4cd2-a813-60caa97b161b service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:18.102832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f86eab-4a7b-4cd2-a813-60caa97b161b service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:18.103131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f86eab-4a7b-4cd2-a813-60caa97b161b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:18.105307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b8f86eab-4a7b-4cd2-a813-60caa97b161b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:18.220453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f86eab-4a7b-4cd2-a813-60caa97b161b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:18.221908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f86eab-4a7b-4cd2-a813-60caa97b161b service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:18.241155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 662/1316] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:20.772848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6427acb-f296-4878-8007-2778ffe02f98 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:20.773716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6427acb-f296-4878-8007-2778ffe02f98 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:20.773716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6427acb-f296-4878-8007-2778ffe02f98 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:20.775703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 655/1317] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:20.781549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d742b2-dae9-4d70-836e-d9850ba019ff None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:20.781985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d742b2-dae9-4d70-836e-d9850ba019ff None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:20.782078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d742b2-dae9-4d70-836e-d9850ba019ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:20.853049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-22d742b2-dae9-4d70-836e-d9850ba019ff None None] MFA Rules not processed for user `8d7618d1e3264e288a59b8636924711f`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:20.854272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-22d742b2-dae9-4d70-836e-d9850ba019ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:20.911657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:20.960115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 663/1318] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:21.004061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6427acb-f296-4878-8007-2778ffe02f98 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:21.006623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b6427acb-f296-4878-8007-2778ffe02f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:21.123494 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6427acb-f296-4878-8007-2778ffe02f98 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:21.126515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:21.206754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e124c73-149f-45ab-9609-1ba5525887d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:21.207370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124c73-149f-45ab-9609-1ba5525887d4 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:21.207664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124c73-149f-45ab-9609-1ba5525887d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:21.207939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124c73-149f-45ab-9609-1ba5525887d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:21.210494 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1e124c73-149f-45ab-9609-1ba5525887d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:21.322805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e124c73-149f-45ab-9609-1ba5525887d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:21.324196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e124c73-149f-45ab-9609-1ba5525887d4 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:21.348656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 656/1319] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:23.891673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac352e-73e8-4ba6-a2ed-47108af6415e None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:23.892549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac352e-73e8-4ba6-a2ed-47108af6415e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:23.892549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac352e-73e8-4ba6-a2ed-47108af6415e None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:23.894654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 664/1320] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:23.900962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2230b7-caa1-462b-bdc5-163e5ff61211 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:23.901734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2230b7-caa1-462b-bdc5-163e5ff61211 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:23.901882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2230b7-caa1-462b-bdc5-163e5ff61211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:23.955533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:23.982664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cd2230b7-caa1-462b-bdc5-163e5ff61211 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:23.983966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cd2230b7-caa1-462b-bdc5-163e5ff61211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:24.093116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 657/1321] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:24.154937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac352e-73e8-4ba6-a2ed-47108af6415e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:24.157336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c3ac352e-73e8-4ba6-a2ed-47108af6415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:24.269488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac352e-73e8-4ba6-a2ed-47108af6415e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:24.355721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae85c0-954d-419d-851d-cd1517bad772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:24.356341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae85c0-954d-419d-851d-cd1517bad772 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:24.356615 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae85c0-954d-419d-851d-cd1517bad772 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:24.356882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae85c0-954d-419d-851d-cd1517bad772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:24.358475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-52ae85c0-954d-419d-851d-cd1517bad772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:24.366173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:24.476905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae85c0-954d-419d-851d-cd1517bad772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:24.478337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae85c0-954d-419d-851d-cd1517bad772 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:24.498614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 665/1322] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:27.390223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc0a8c-7605-4962-bef7-513379d74bbf None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:27.390764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc0a8c-7605-4962-bef7-513379d74bbf None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:27.390845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc0a8c-7605-4962-bef7-513379d74bbf None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:27.392613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 658/1323] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:27.398067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb6d2-0979-4120-87ca-6ce4d92c4dcd None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:27.398594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb6d2-0979-4120-87ca-6ce4d92c4dcd None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:27.398594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb6d2-0979-4120-87ca-6ce4d92c4dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:27.467640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7b2bb6d2-0979-4120-87ca-6ce4d92c4dcd None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:27.468858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7b2bb6d2-0979-4120-87ca-6ce4d92c4dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:27.528409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:27.576140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 666/1324] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:24:27.612677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc0a8c-7605-4962-bef7-513379d74bbf None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:27.614238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1adc0a8c-7605-4962-bef7-513379d74bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:27.729482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc0a8c-7605-4962-bef7-513379d74bbf None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:27.742656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:27.809536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4768aa-66b8-4ff2-81b3-ff321e2f64cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:27.810210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4768aa-66b8-4ff2-81b3-ff321e2f64cf service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:27.810488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4768aa-66b8-4ff2-81b3-ff321e2f64cf service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:27.810782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4768aa-66b8-4ff2-81b3-ff321e2f64cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:27.812814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ad4768aa-66b8-4ff2-81b3-ff321e2f64cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:27.923193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4768aa-66b8-4ff2-81b3-ff321e2f64cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:27.924660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4768aa-66b8-4ff2-81b3-ff321e2f64cf service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:27.943414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 659/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:29.975304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a6342-8d6a-4872-8786-49ca45cfa9e7 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:29.975895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a6342-8d6a-4872-8786-49ca45cfa9e7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:29.975895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a6342-8d6a-4872-8786-49ca45cfa9e7 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:29.977280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 667/1326] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:29.982956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c7ed-6c43-431a-afc8-b41e037f1a94 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:29.983410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c7ed-6c43-431a-afc8-b41e037f1a94 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:29.983535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c7ed-6c43-431a-afc8-b41e037f1a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:30.035143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:30.053628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a099c7ed-6c43-431a-afc8-b41e037f1a94 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:30.054842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a099c7ed-6c43-431a-afc8-b41e037f1a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:30.153877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 660/1327] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:30.191013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a6342-8d6a-4872-8786-49ca45cfa9e7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:30.193465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7d7a6342-8d6a-4872-8786-49ca45cfa9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:30.303558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a6342-8d6a-4872-8786-49ca45cfa9e7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:30.382691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d56020-8e76-4b83-a7b5-b99dea770460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:30.383293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d56020-8e76-4b83-a7b5-b99dea770460 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:30.383573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d56020-8e76-4b83-a7b5-b99dea770460 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:30.383876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d56020-8e76-4b83-a7b5-b99dea770460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:30.385526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f7d56020-8e76-4b83-a7b5-b99dea770460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:30.402913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:30.503049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d56020-8e76-4b83-a7b5-b99dea770460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:30.504521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d56020-8e76-4b83-a7b5-b99dea770460 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:30.523420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 668/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:32.542039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e25ce1-a516-430b-aec7-260a5ea7fc2f None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:32.542653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e25ce1-a516-430b-aec7-260a5ea7fc2f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:32.542653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e25ce1-a516-430b-aec7-260a5ea7fc2f None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:32.544068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 661/1329] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:32.549311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446627ca-f39b-4442-95d3-937753fb0912 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:32.549761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446627ca-f39b-4442-95d3-937753fb0912 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:32.549862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446627ca-f39b-4442-95d3-937753fb0912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:32.618218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-446627ca-f39b-4442-95d3-937753fb0912 None None] MFA Rules not processed for user `8d7618d1e3264e288a59b8636924711f`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:32.619433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-446627ca-f39b-4442-95d3-937753fb0912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:32.688332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:32.723289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 669/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:24:32.764084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e25ce1-a516-430b-aec7-260a5ea7fc2f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:32.765751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-45e25ce1-a516-430b-aec7-260a5ea7fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:32.880208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e25ce1-a516-430b-aec7-260a5ea7fc2f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:32.900873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:32.960260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd682a9-9167-4734-9176-f43578aeb5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:32.960895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd682a9-9167-4734-9176-f43578aeb5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:32.961169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd682a9-9167-4734-9176-f43578aeb5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:32.961459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd682a9-9167-4734-9176-f43578aeb5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:32.963117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6cd682a9-9167-4734-9176-f43578aeb5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:33.081048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd682a9-9167-4734-9176-f43578aeb5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:33.082641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd682a9-9167-4734-9176-f43578aeb5b6 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:33.101985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 662/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:35.369358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438dcf-8981-4c76-bcad-004eb3d77592 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:35.369882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438dcf-8981-4c76-bcad-004eb3d77592 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:35.369882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438dcf-8981-4c76-bcad-004eb3d77592 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:35.371241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 670/1332] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:35.377290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec780cfd-dbcf-458c-9fff-3566462215da None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:35.377789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec780cfd-dbcf-458c-9fff-3566462215da None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:35.378273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec780cfd-dbcf-458c-9fff-3566462215da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:35.461983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:35.465364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ec780cfd-dbcf-458c-9fff-3566462215da None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:35.467260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ec780cfd-dbcf-458c-9fff-3566462215da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:35.572158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 663/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:35.610950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438dcf-8981-4c76-bcad-004eb3d77592 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:35.612577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8e438dcf-8981-4c76-bcad-004eb3d77592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:35.734104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438dcf-8981-4c76-bcad-004eb3d77592 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:35.822744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27a36f-f685-40df-8bb9-6c6e480fa039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:35.823367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a36f-f685-40df-8bb9-6c6e480fa039 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:35.823664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a36f-f685-40df-8bb9-6c6e480fa039 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:35.823948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a36f-f685-40df-8bb9-6c6e480fa039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:35.825589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7d27a36f-f685-40df-8bb9-6c6e480fa039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:35.852697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:35.940980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27a36f-f685-40df-8bb9-6c6e480fa039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:35.942656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27a36f-f685-40df-8bb9-6c6e480fa039 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:35.962326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 671/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:37.980608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efd9d-1933-49a4-95ce-6c50afdada9b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:37.981550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efd9d-1933-49a4-95ce-6c50afdada9b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:37.981550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efd9d-1933-49a4-95ce-6c50afdada9b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:37.983707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 664/1335] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:37.989129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489bd7e-b579-48be-b880-f3db6554d181 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:37.989568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489bd7e-b579-48be-b880-f3db6554d181 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:37.989681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489bd7e-b579-48be-b880-f3db6554d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:38.056357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-c489bd7e-b579-48be-b880-f3db6554d181 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:38.057576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c489bd7e-b579-48be-b880-f3db6554d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:38.142660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:38.167188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 672/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:38.212468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efd9d-1933-49a4-95ce-6c50afdada9b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:38.214970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7a2efd9d-1933-49a4-95ce-6c50afdada9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:38.334063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efd9d-1933-49a4-95ce-6c50afdada9b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:38.363044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:38.410441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dfe1e-a3c4-4189-8f22-0fb1afee0fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:38.411069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dfe1e-a3c4-4189-8f22-0fb1afee0fbd service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:38.411350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dfe1e-a3c4-4189-8f22-0fb1afee0fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:38.411644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dfe1e-a3c4-4189-8f22-0fb1afee0fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:38.413314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dc5dfe1e-a3c4-4189-8f22-0fb1afee0fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:38.534292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dfe1e-a3c4-4189-8f22-0fb1afee0fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:38.535777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dfe1e-a3c4-4189-8f22-0fb1afee0fbd service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:38.554060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 665/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:40.919953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81570e-1683-421f-b3f7-637d8d54a3af None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:40.920828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81570e-1683-421f-b3f7-637d8d54a3af None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:40.920828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81570e-1683-421f-b3f7-637d8d54a3af None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:40.923040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 673/1338] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:40.929280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318e96-1709-4b32-b679-b268df6ec2c2 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:40.929745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318e96-1709-4b32-b679-b268df6ec2c2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:40.929973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318e96-1709-4b32-b679-b268df6ec2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:41.006174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f9318e96-1709-4b32-b679-b268df6ec2c2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:41.007391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f9318e96-1709-4b32-b679-b268df6ec2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:41.015940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:41.111148 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 666/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:41.152657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81570e-1683-421f-b3f7-637d8d54a3af None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:41.154871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ab81570e-1683-421f-b3f7-637d8d54a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:41.266788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81570e-1683-421f-b3f7-637d8d54a3af None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:41.353400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0ccd1-99ff-4dac-ae61-da42166a0aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:41.354037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ccd1-99ff-4dac-ae61-da42166a0aac service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:41.354318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ccd1-99ff-4dac-ae61-da42166a0aac service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:41.354730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ccd1-99ff-4dac-ae61-da42166a0aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:41.356426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-eac0ccd1-99ff-4dac-ae61-da42166a0aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:41.393939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:41.474541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0ccd1-99ff-4dac-ae61-da42166a0aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:41.476023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0ccd1-99ff-4dac-ae61-da42166a0aac service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:41.494308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 674/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:45.524793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a62f6-70e7-40d2-902b-da39086f31c3 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:45.525307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a62f6-70e7-40d2-902b-da39086f31c3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:45.525307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a62f6-70e7-40d2-902b-da39086f31c3 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:45.526673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 667/1341] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:24:45.532190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb912a-f3b1-4063-b34d-f303f448b820 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:45.532623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb912a-f3b1-4063-b34d-f303f448b820 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:45.532747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb912a-f3b1-4063-b34d-f303f448b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:45.601055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2cfb912a-f3b1-4063-b34d-f303f448b820 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:45.602295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2cfb912a-f3b1-4063-b34d-f303f448b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:45.688446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:45.700576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 675/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:45.739107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a62f6-70e7-40d2-902b-da39086f31c3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:45.740670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-362a62f6-70e7-40d2-902b-da39086f31c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:45.851289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a62f6-70e7-40d2-902b-da39086f31c3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:45.889162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:45.928572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352aa90-48aa-48e0-bb30-4560e108a9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:45.929206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352aa90-48aa-48e0-bb30-4560e108a9da service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:45.929737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352aa90-48aa-48e0-bb30-4560e108a9da service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:45.930010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352aa90-48aa-48e0-bb30-4560e108a9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:45.931636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d352aa90-48aa-48e0-bb30-4560e108a9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:46.041289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352aa90-48aa-48e0-bb30-4560e108a9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:46.042752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352aa90-48aa-48e0-bb30-4560e108a9da service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:46.060868 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 668/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:48.669059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699ca6f-f873-4be3-8d19-425a115cc3c3 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:48.669657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699ca6f-f873-4be3-8d19-425a115cc3c3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:48.669657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699ca6f-f873-4be3-8d19-425a115cc3c3 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:48.671000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 676/1344] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:48.677323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b82497-c8f2-41b1-93d4-adeee7a3be02 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:48.677878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b82497-c8f2-41b1-93d4-adeee7a3be02 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:48.677878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b82497-c8f2-41b1-93d4-adeee7a3be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:48.754051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-81b82497-c8f2-41b1-93d4-adeee7a3be02 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:48.755316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-81b82497-c8f2-41b1-93d4-adeee7a3be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:48.775757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:48.865860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 669/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:48.907805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699ca6f-f873-4be3-8d19-425a115cc3c3 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:48.909383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3699ca6f-f873-4be3-8d19-425a115cc3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:49.017342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699ca6f-f873-4be3-8d19-425a115cc3c3 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:49.094879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abf052-7a35-4846-a456-123b65f33058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:49.095418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf052-7a35-4846-a456-123b65f33058 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:49.095732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf052-7a35-4846-a456-123b65f33058 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:49.096005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf052-7a35-4846-a456-123b65f33058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:49.097654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e6abf052-7a35-4846-a456-123b65f33058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:49.141807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:49.211664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abf052-7a35-4846-a456-123b65f33058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:49.213132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abf052-7a35-4846-a456-123b65f33058 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:49.233427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 677/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:53.201315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac8ee1-01a5-442d-98f9-c6d6611d0a5f None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:53.201828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac8ee1-01a5-442d-98f9-c6d6611d0a5f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:53.201828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac8ee1-01a5-442d-98f9-c6d6611d0a5f None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:53.203228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 670/1347] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:53.208801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6d5e2-e57b-4a98-9505-9161f8b2c3c4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:53.209254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6d5e2-e57b-4a98-9505-9161f8b2c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:53.209365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6d5e2-e57b-4a98-9505-9161f8b2c3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:53.276866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f8e6d5e2-e57b-4a98-9505-9161f8b2c3c4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:53.278106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f8e6d5e2-e57b-4a98-9505-9161f8b2c3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:53.376079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:53.379659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 678/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:24:53.417190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac8ee1-01a5-442d-98f9-c6d6611d0a5f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:24:53.418840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0fac8ee1-01a5-442d-98f9-c6d6611d0a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:53.545210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac8ee1-01a5-442d-98f9-c6d6611d0a5f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:24:53.596815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:53.624136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500012c8-56ca-4649-98ed-96a08fb81c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:24:53.624773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500012c8-56ca-4649-98ed-96a08fb81c9a service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:53.625047 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500012c8-56ca-4649-98ed-96a08fb81c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:53.625317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500012c8-56ca-4649-98ed-96a08fb81c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:53.626982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-500012c8-56ca-4649-98ed-96a08fb81c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:53.741152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500012c8-56ca-4649-98ed-96a08fb81c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:24:53.742528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500012c8-56ca-4649-98ed-96a08fb81c9a service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:24:53.761456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 671/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:24:58.603865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019e85-2af2-4fc1-8133-834456fd249a None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:58.604388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019e85-2af2-4fc1-8133-834456fd249a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:58.604632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019e85-2af2-4fc1-8133-834456fd249a None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:58.606328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 679/1350] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:24:58.612376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef52b6-f908-4a85-bf60-47286c617de3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:24:58.612892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef52b6-f908-4a85-bf60-47286c617de3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:24:58.613277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef52b6-f908-4a85-bf60-47286c617de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:24:58.761650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f9ef52b6-f908-4a85-bf60-47286c617de3 None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:24:58.763165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f9ef52b6-f908-4a85-bf60-47286c617de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:24:58.785069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:24:58.902509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 672/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:24:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:02.959892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd72f-c290-48b6-be5c-e7f39ff928ff None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:02.960469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd72f-c290-48b6-be5c-e7f39ff928ff None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:02.960760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd72f-c290-48b6-be5c-e7f39ff928ff None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:02.962229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 680/1352] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:02.967908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c68ac-954b-43d1-b93c-f5d977669978 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:02.968372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c68ac-954b-43d1-b93c-f5d977669978 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:02.968463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c68ac-954b-43d1-b93c-f5d977669978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:03.057270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e28c68ac-954b-43d1-b93c-f5d977669978 None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:03.058708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e28c68ac-954b-43d1-b93c-f5d977669978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:03.134414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:03.173132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 673/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:25:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:04.657282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8378e8-9588-4f5d-98cd-be892ed4d188 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:04.657880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8378e8-9588-4f5d-98cd-be892ed4d188 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:04.657880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8378e8-9588-4f5d-98cd-be892ed4d188 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:04.659186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 681/1354] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:04.664392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db7bc-94bc-4c11-ad4c-84a1e1931280 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:04.664821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db7bc-94bc-4c11-ad4c-84a1e1931280 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:04.664994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db7bc-94bc-4c11-ad4c-84a1e1931280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:04.743768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-545db7bc-94bc-4c11-ad4c-84a1e1931280 None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:04.744994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-545db7bc-94bc-4c11-ad4c-84a1e1931280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:04.858572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 674/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:25:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:08.172135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee81ad3-4f6d-485b-befe-96d145f87f2c None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:08.173012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee81ad3-4f6d-485b-befe-96d145f87f2c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:08.173438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee81ad3-4f6d-485b-befe-96d145f87f2c None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:08.176486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 682/1356] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:08.182932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b17e-dded-481b-91a8-808099af51ec None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:08.182932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b17e-dded-481b-91a8-808099af51ec None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:08.182932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b17e-dded-481b-91a8-808099af51ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:08.227059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:08.263500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-eef5b17e-dded-481b-91a8-808099af51ec None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:08.264766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-eef5b17e-dded-481b-91a8-808099af51ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:08.370894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 675/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:08.425330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032a3dd-c4d6-439d-9cee-cc1f56338487 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:08.426430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032a3dd-c4d6-439d-9cee-cc1f56338487 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:08.426941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032a3dd-c4d6-439d-9cee-cc1f56338487 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:08.428618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 683/1358] 10.222.0.58 () {54 vars in 962 bytes} [Thu Jul 28 06:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:08.437675 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924398-4c8c-4345-a9f9-b5f8c9ff5907 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:08.438495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924398-4c8c-4345-a9f9-b5f8c9ff5907 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:08.439385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924398-4c8c-4345-a9f9-b5f8c9ff5907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:08.528206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-89924398-4c8c-4345-a9f9-b5f8c9ff5907 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:08.529417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-89924398-4c8c-4345-a9f9-b5f8c9ff5907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:08.580420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:08.651685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 676/1359] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Jul 28 06:25:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:08.660097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032a3dd-c4d6-439d-9cee-cc1f56338487 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:08.661853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1032a3dd-c4d6-439d-9cee-cc1f56338487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:08.819868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032a3dd-c4d6-439d-9cee-cc1f56338487 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:08.896690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:08.942501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aaae7-d79a-4413-bf4f-c4113657c6f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:08.943126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aaae7-d79a-4413-bf4f-c4113657c6f8 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:08.943407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aaae7-d79a-4413-bf4f-c4113657c6f8 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:08.943722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aaae7-d79a-4413-bf4f-c4113657c6f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:08.945366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b36aaae7-d79a-4413-bf4f-c4113657c6f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:09.050093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aaae7-d79a-4413-bf4f-c4113657c6f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:09.051706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aaae7-d79a-4413-bf4f-c4113657c6f8 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:09.072913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 684/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:11.285731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fabc3-d638-40b5-8927-d4ad2dced37e None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:11.286395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fabc3-d638-40b5-8927-d4ad2dced37e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:11.286395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fabc3-d638-40b5-8927-d4ad2dced37e None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:11.291593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 677/1361] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:11.293388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6bf9-c2b8-4a87-be79-a5450b122e2e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:11.293841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6bf9-c2b8-4a87-be79-a5450b122e2e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:11.294029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6bf9-c2b8-4a87-be79-a5450b122e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:11.367566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a65a6bf9-c2b8-4a87-be79-a5450b122e2e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:11.369020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a65a6bf9-c2b8-4a87-be79-a5450b122e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:11.408851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:11.475259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 685/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:11.521749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fabc3-d638-40b5-8927-d4ad2dced37e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:11.524623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-942fabc3-d638-40b5-8927-d4ad2dced37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:11.713254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fabc3-d638-40b5-8927-d4ad2dced37e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:11.723422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:11.877325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6cf7f-8714-44a4-b205-baad2c73ec79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:11.877954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cf7f-8714-44a4-b205-baad2c73ec79 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:11.878233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cf7f-8714-44a4-b205-baad2c73ec79 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:11.878506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cf7f-8714-44a4-b205-baad2c73ec79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:11.880169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2ac6cf7f-8714-44a4-b205-baad2c73ec79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:11.973885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6cf7f-8714-44a4-b205-baad2c73ec79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:11.975515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6cf7f-8714-44a4-b205-baad2c73ec79 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:11.994064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 678/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:14.362526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686d25-5695-4a80-b9ab-0a3f57ec6a72 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:14.363121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686d25-5695-4a80-b9ab-0a3f57ec6a72 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:14.363121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686d25-5695-4a80-b9ab-0a3f57ec6a72 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:14.364764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 686/1364] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:14.370100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625463-a914-4c10-8977-7b6c63817f63 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:14.370583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625463-a914-4c10-8977-7b6c63817f63 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:14.370694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625463-a914-4c10-8977-7b6c63817f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:14.386635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:14.445051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-30625463-a914-4c10-8977-7b6c63817f63 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:14.446752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-30625463-a914-4c10-8977-7b6c63817f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:14.557878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 679/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:14.606399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28b3d-f2bd-415d-b2ff-c121e27453d4 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:14.607036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28b3d-f2bd-415d-b2ff-c121e27453d4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:14.607407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28b3d-f2bd-415d-b2ff-c121e27453d4 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:14.608943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 687/1366] 10.222.0.58 () {54 vars in 962 bytes} [Thu Jul 28 06:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:14.614645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa789b-e5de-4e47-8c87-c57f35e215be None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:14.614970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa789b-e5de-4e47-8c87-c57f35e215be None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:14.615252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa789b-e5de-4e47-8c87-c57f35e215be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:14.694630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a3aa789b-e5de-4e47-8c87-c57f35e215be None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:14.695857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a3aa789b-e5de-4e47-8c87-c57f35e215be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:14.734162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:14.823695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 680/1367] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Jul 28 06:25:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:14.832243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28b3d-f2bd-415d-b2ff-c121e27453d4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:14.834088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fec28b3d-f2bd-415d-b2ff-c121e27453d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:14.986967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28b3d-f2bd-415d-b2ff-c121e27453d4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:15.009139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:15.114786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf9741-962e-44e6-b5c7-9bc50c919dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:15.115696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9741-962e-44e6-b5c7-9bc50c919dc3 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:15.116196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9741-962e-44e6-b5c7-9bc50c919dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:15.116552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9741-962e-44e6-b5c7-9bc50c919dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:15.118547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e3bf9741-962e-44e6-b5c7-9bc50c919dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:15.215459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf9741-962e-44e6-b5c7-9bc50c919dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:15.217642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf9741-962e-44e6-b5c7-9bc50c919dc3 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:15.247008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 688/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:16.143039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64c3b-2d54-4da3-a567-8e63a82395f6 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:16.143437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64c3b-2d54-4da3-a567-8e63a82395f6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:16.143536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64c3b-2d54-4da3-a567-8e63a82395f6 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:16.148785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 681/1369] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:16.150725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0233b-5df4-4155-a96d-c97919955ea4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:16.151246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0233b-5df4-4155-a96d-c97919955ea4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:16.151361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0233b-5df4-4155-a96d-c97919955ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:16.187118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:16.224789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-20c0233b-5df4-4155-a96d-c97919955ea4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:16.226003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-20c0233b-5df4-4155-a96d-c97919955ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:16.349369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 689/1370] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:16.706815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e764ab9-8457-412c-8903-7094cd35104c None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:16.706815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e764ab9-8457-412c-8903-7094cd35104c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:16.706815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e764ab9-8457-412c-8903-7094cd35104c None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:16.708216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 682/1371] 10.222.0.58 () {54 vars in 964 bytes} [Thu Jul 28 06:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:16.713313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0eb4-1d93-403a-b245-8599ebcbccab None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:16.713814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0eb4-1d93-403a-b245-8599ebcbccab None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:16.714180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0eb4-1d93-403a-b245-8599ebcbccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:16.802593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-290b0eb4-1d93-403a-b245-8599ebcbccab None None] MFA Rules not processed for user `0c08bdb04cc146fa8f6c6bb626c30437`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:16.804004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-290b0eb4-1d93-403a-b245-8599ebcbccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:16.856373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:16.889307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 690/1372] 10.222.0.58 () {58 vars in 1061 bytes} [Thu Jul 28 06:25:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:16.897263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e764ab9-8457-412c-8903-7094cd35104c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:16.898915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5e764ab9-8457-412c-8903-7094cd35104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:17.022862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e764ab9-8457-412c-8903-7094cd35104c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:17.070362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:17.108889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:17.109732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:17.110121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:17.110498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:17.112537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:17.256072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:17.259174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:17.287587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e725-f640-40d5-988d-be0e8a91e835 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:17.287587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e725-f640-40d5-988d-be0e8a91e835 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:17.287587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e725-f640-40d5-988d-be0e8a91e835 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:17.295467 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 691/1373] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:25:17.295467 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24288123-de84-45df-8257-c5198acec7be None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:17.298290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24288123-de84-45df-8257-c5198acec7be None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:17.298290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24288123-de84-45df-8257-c5198acec7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:17.301405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 683/1374] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:17.383208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-24288123-de84-45df-8257-c5198acec7be None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:17.384925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-24288123-de84-45df-8257-c5198acec7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:17.494099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 692/1375] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:17.540269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:17.540269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:17.634442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:17.667303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032caa5-cc25-461e-b358-5d2488a0d8f1 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:17.787639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e678e66-ad85-463f-b2d0-0440728b715e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:17.788387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678e66-ad85-463f-b2d0-0440728b715e service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:17.788657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678e66-ad85-463f-b2d0-0440728b715e service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:17.788946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678e66-ad85-463f-b2d0-0440728b715e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:17.790644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4e678e66-ad85-463f-b2d0-0440728b715e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:17.871018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:17.882827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e678e66-ad85-463f-b2d0-0440728b715e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:17.884471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e678e66-ad85-463f-b2d0-0440728b715e service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:17.902503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 684/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:19.943763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e78da-e91b-46f1-bc63-74be7c99e7bc None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:19.944248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e78da-e91b-46f1-bc63-74be7c99e7bc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:19.944345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e78da-e91b-46f1-bc63-74be7c99e7bc None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:19.945674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 693/1377] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:19.951200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147b05-3f95-4588-b9ae-ff38852d9f31 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:19.951658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147b05-3f95-4588-b9ae-ff38852d9f31 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:19.951767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147b05-3f95-4588-b9ae-ff38852d9f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:20.021269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7b147b05-3f95-4588-b9ae-ff38852d9f31 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:20.022505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7b147b05-3f95-4588-b9ae-ff38852d9f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:20.141028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 685/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:20.186691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e78da-e91b-46f1-bc63-74be7c99e7bc None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:20.188290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ad1e78da-e91b-46f1-bc63-74be7c99e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:20.256097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:20.374036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e78da-e91b-46f1-bc63-74be7c99e7bc None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:20.489114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03a9b5-cdb1-470e-8834-38a869206fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:20.489746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03a9b5-cdb1-470e-8834-38a869206fe5 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:20.490027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03a9b5-cdb1-470e-8834-38a869206fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:20.490321 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03a9b5-cdb1-470e-8834-38a869206fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:20.491966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9d03a9b5-cdb1-470e-8834-38a869206fe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:20.503771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:20.592163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03a9b5-cdb1-470e-8834-38a869206fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:20.593763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03a9b5-cdb1-470e-8834-38a869206fe5 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:20.617537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 694/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:22.675266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732684-e6e1-4171-b40f-b7712619f396 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:22.675804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732684-e6e1-4171-b40f-b7712619f396 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:22.675804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732684-e6e1-4171-b40f-b7712619f396 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:22.677293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 686/1380] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:22.682469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6ed69-729d-4fcc-8a0d-ea4447016e05 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:22.682860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6ed69-729d-4fcc-8a0d-ea4447016e05 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:22.683082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6ed69-729d-4fcc-8a0d-ea4447016e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:22.758962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f1b6ed69-729d-4fcc-8a0d-ea4447016e05 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:22.760520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f1b6ed69-729d-4fcc-8a0d-ea4447016e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:22.855186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:22.867820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 695/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:22.911036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732684-e6e1-4171-b40f-b7712619f396 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:22.913182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f5732684-e6e1-4171-b40f-b7712619f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:22.984447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:23.081883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732684-e6e1-4171-b40f-b7712619f396 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:23.206195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd9a22-c9f7-4266-afc0-5c45c43d2eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:23.206819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9a22-c9f7-4266-afc0-5c45c43d2eb8 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:23.207101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9a22-c9f7-4266-afc0-5c45c43d2eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:23.207374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9a22-c9f7-4266-afc0-5c45c43d2eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:23.209024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-53fd9a22-c9f7-4266-afc0-5c45c43d2eb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:23.231852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:23.304204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd9a22-c9f7-4266-afc0-5c45c43d2eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:23.305810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd9a22-c9f7-4266-afc0-5c45c43d2eb8 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:23.325678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 687/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:25.477498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41722932-fa40-4f12-a82d-3d61f6fa7be1 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:25.478154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41722932-fa40-4f12-a82d-3d61f6fa7be1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:25.478154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41722932-fa40-4f12-a82d-3d61f6fa7be1 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:25.479938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 696/1383] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:25.487537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546c186-e48a-4454-ab36-89e0fdc6095c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:25.488037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546c186-e48a-4454-ab36-89e0fdc6095c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:25.488437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546c186-e48a-4454-ab36-89e0fdc6095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:25.581216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5546c186-e48a-4454-ab36-89e0fdc6095c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:25.583050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5546c186-e48a-4454-ab36-89e0fdc6095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:25.706155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:25.710383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 688/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:25.752865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41722932-fa40-4f12-a82d-3d61f6fa7be1 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:25.755317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-41722932-fa40-4f12-a82d-3d61f6fa7be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:25.925549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41722932-fa40-4f12-a82d-3d61f6fa7be1 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:25.991026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:26.053193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3be9-e983-4279-9606-d06d933ac4f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:26.054085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3be9-e983-4279-9606-d06d933ac4f1 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:26.054370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3be9-e983-4279-9606-d06d933ac4f1 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:26.054643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3be9-e983-4279-9606-d06d933ac4f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:26.056383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b6da3be9-e983-4279-9606-d06d933ac4f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:26.159127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da3be9-e983-4279-9606-d06d933ac4f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:26.161015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da3be9-e983-4279-9606-d06d933ac4f1 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:26.181078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 697/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:28.753943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994c1a-a46a-4587-a17e-d482a8491270 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:28.754617 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994c1a-a46a-4587-a17e-d482a8491270 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:28.754724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994c1a-a46a-4587-a17e-d482a8491270 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:28.756662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 689/1386] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:28.763762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d1ef-4229-441a-bf16-42c3d26e4c3e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:28.764213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d1ef-4229-441a-bf16-42c3d26e4c3e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:28.764320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d1ef-4229-441a-bf16-42c3d26e4c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:28.845598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-88d6d1ef-4229-441a-bf16-42c3d26e4c3e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:28.846888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-88d6d1ef-4229-441a-bf16-42c3d26e4c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:28.874959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:28.960824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 698/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:29.021063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994c1a-a46a-4587-a17e-d482a8491270 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:29.023207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ee994c1a-a46a-4587-a17e-d482a8491270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:29.220977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994c1a-a46a-4587-a17e-d482a8491270 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:29.302237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:29.347242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22780d-9162-493e-ba20-96dcddaaa236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:29.347960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22780d-9162-493e-ba20-96dcddaaa236 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:29.348240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22780d-9162-493e-ba20-96dcddaaa236 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:29.348507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22780d-9162-493e-ba20-96dcddaaa236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:29.350187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ae22780d-9162-493e-ba20-96dcddaaa236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:29.466388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22780d-9162-493e-ba20-96dcddaaa236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:29.468090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22780d-9162-493e-ba20-96dcddaaa236 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:29.487008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 690/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:31.740878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea37e-b6b4-42fe-9bba-c3d98cce87b7 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:31.741452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea37e-b6b4-42fe-9bba-c3d98cce87b7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:31.741452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea37e-b6b4-42fe-9bba-c3d98cce87b7 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:31.742773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 699/1389] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:31.749510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957add-02cc-421c-a45a-9adeaf25d165 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:31.750049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957add-02cc-421c-a45a-9adeaf25d165 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:31.750049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957add-02cc-421c-a45a-9adeaf25d165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:31.816608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ed957add-02cc-421c-a45a-9adeaf25d165 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:31.817813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ed957add-02cc-421c-a45a-9adeaf25d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:31.854882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:31.918642 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 691/1390] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:25:31.963953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccea37e-b6b4-42fe-9bba-c3d98cce87b7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:31.965555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dccea37e-b6b4-42fe-9bba-c3d98cce87b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:32.119712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccea37e-b6b4-42fe-9bba-c3d98cce87b7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:32.129591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:32.234594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c7efa-5e8e-459b-a145-16148aafdb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:32.235223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7efa-5e8e-459b-a145-16148aafdb71 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:32.235527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7efa-5e8e-459b-a145-16148aafdb71 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:32.235822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7efa-5e8e-459b-a145-16148aafdb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:32.237446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9d4c7efa-5e8e-459b-a145-16148aafdb71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:32.330013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c7efa-5e8e-459b-a145-16148aafdb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:32.331548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c7efa-5e8e-459b-a145-16148aafdb71 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:32.350670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 700/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:32.425444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f6301-f5a1-429a-92b8-b2ed270a755f None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:32.426353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f6301-f5a1-429a-92b8-b2ed270a755f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:32.426670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f6301-f5a1-429a-92b8-b2ed270a755f None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:32.428221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 692/1392] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:32.434623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932139-f621-462d-8655-d317b8814193 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:32.434979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932139-f621-462d-8655-d317b8814193 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:32.435181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932139-f621-462d-8655-d317b8814193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:32.452132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:32.512028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3e932139-f621-462d-8655-d317b8814193 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:32.513547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3e932139-f621-462d-8655-d317b8814193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:32.621327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 701/1393] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:32.677105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0781d5d-d07a-4ca1-a829-8c9e7c40daf6 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:32.677396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0781d5d-d07a-4ca1-a829-8c9e7c40daf6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:32.677692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0781d5d-d07a-4ca1-a829-8c9e7c40daf6 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:32.679033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 693/1394] 10.222.0.58 () {54 vars in 966 bytes} [Thu Jul 28 06:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:32.684933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e729-3c27-4fc7-a917-32a453c8cf9f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:32.685223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e729-3c27-4fc7-a917-32a453c8cf9f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:32.685499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e729-3c27-4fc7-a917-32a453c8cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:32.762800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2688e729-3c27-4fc7-a917-32a453c8cf9f None None] MFA Rules not processed for user `d1e0e81d0ee04020b43c28347ef3ab6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:32.764043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2688e729-3c27-4fc7-a917-32a453c8cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:32.800647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:32.844796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 702/1395] 10.222.0.58 () {58 vars in 1063 bytes} [Thu Jul 28 06:25:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:25:32.852493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0781d5d-d07a-4ca1-a829-8c9e7c40daf6 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:32.854083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a0781d5d-d07a-4ca1-a829-8c9e7c40daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:32.960955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0781d5d-d07a-4ca1-a829-8c9e7c40daf6 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:33.027348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:33.039528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6d2c8-e648-4368-8cc4-26fa5b443747 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1e0e81d0ee04020b43c28347ef3ab6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:33.040193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6d2c8-e648-4368-8cc4-26fa5b443747 service glance] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:33.040471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6d2c8-e648-4368-8cc4-26fa5b443747 service glance] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:33.040835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6d2c8-e648-4368-8cc4-26fa5b443747 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:33.042458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-85c6d2c8-e648-4368-8cc4-26fa5b443747 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:33.153916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6d2c8-e648-4368-8cc4-26fa5b443747 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:33.155377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6d2c8-e648-4368-8cc4-26fa5b443747 service glance] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:33.174525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 694/1396] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:25:33.941475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68412-56c2-456a-899c-b13ecb355fce None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:33.941931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68412-56c2-456a-899c-b13ecb355fce None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:33.942153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68412-56c2-456a-899c-b13ecb355fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:34.010278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1be68412-56c2-456a-899c-b13ecb355fce None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:34.011500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1be68412-56c2-456a-899c-b13ecb355fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:34.100370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 703/1397] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:34.146232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79034e-291e-4071-a059-aa023f52d53b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:34.146771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79034e-291e-4071-a059-aa023f52d53b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:34.146771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79034e-291e-4071-a059-aa023f52d53b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:34.148212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 695/1398] 10.222.0.58 () {54 vars in 943 bytes} [Thu Jul 28 06:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:34.154755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42469d9-e115-4a24-bdce-76b58aa8fdc7 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:34.155037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42469d9-e115-4a24-bdce-76b58aa8fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:34.155309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42469d9-e115-4a24-bdce-76b58aa8fdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:34.212252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:34.230756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f42469d9-e115-4a24-bdce-76b58aa8fdc7 None None] MFA Rules not processed for user `969f6ef78a6342e49325ea63f50b69ea`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:34.231964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f42469d9-e115-4a24-bdce-76b58aa8fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:34.341542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 704/1399] 10.222.0.58 () {58 vars in 1040 bytes} [Thu Jul 28 06:25:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:34.351294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79034e-291e-4071-a059-aa023f52d53b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:34.352876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6a79034e-291e-4071-a059-aa023f52d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:34.403202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee906-172a-4ce2-b213-dfc752aadd33 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:34.403463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee906-172a-4ce2-b213-dfc752aadd33 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:34.403773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee906-172a-4ce2-b213-dfc752aadd33 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:34.405279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 705/1400] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:25:34.410142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:34.410427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:34.410706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:34.455771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:34.486303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:34.487475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:34.504966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79034e-291e-4071-a059-aa023f52d53b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:34.542308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:34.584078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 706/1401] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:25:34.610376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6bea2-e778-4784-93c2-e54cb168d02c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:34.611006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6bea2-e778-4784-93c2-e54cb168d02c service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:34.611288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6bea2-e778-4784-93c2-e54cb168d02c service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:34.611562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6bea2-e778-4784-93c2-e54cb168d02c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:34.613250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-05d6bea2-e778-4784-93c2-e54cb168d02c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:34.631661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:34.633310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:34.689884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:34.700831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6bea2-e778-4784-93c2-e54cb168d02c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:34.702482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6bea2-e778-4784-93c2-e54cb168d02c service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:34.711062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 696/1402] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:25:34.752590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0901439-02e8-4e98-9da3-1dd984c2f576 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:34.827099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:34.881068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e274820-c580-4add-85e9-11bf37b61c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:34.881804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e274820-c580-4add-85e9-11bf37b61c12 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:34.882150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e274820-c580-4add-85e9-11bf37b61c12 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:34.882425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e274820-c580-4add-85e9-11bf37b61c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:34.884111 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9e274820-c580-4add-85e9-11bf37b61c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:34.980579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e274820-c580-4add-85e9-11bf37b61c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:34.982249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e274820-c580-4add-85e9-11bf37b61c12 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:35.001751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 707/1403] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:37.029265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13fc9-d8ac-4fb9-b09e-c9beead77176 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:37.029853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13fc9-d8ac-4fb9-b09e-c9beead77176 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:37.029853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13fc9-d8ac-4fb9-b09e-c9beead77176 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:37.031168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 697/1404] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:37.038523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4a7a5-4d27-4aa3-813a-e13081fef56c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:37.038523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4a7a5-4d27-4aa3-813a-e13081fef56c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:37.038523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4a7a5-4d27-4aa3-813a-e13081fef56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:37.110980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-fcc4a7a5-4d27-4aa3-813a-e13081fef56c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:37.112243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fcc4a7a5-4d27-4aa3-813a-e13081fef56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:37.150041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:37.223840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 708/1405] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:37.269454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13fc9-d8ac-4fb9-b09e-c9beead77176 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:37.271798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-14b13fc9-d8ac-4fb9-b09e-c9beead77176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:37.442238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13fc9-d8ac-4fb9-b09e-c9beead77176 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:37.513459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:37.572407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df685e-b93c-4531-b858-a2ab529b73ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:37.573244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df685e-b93c-4531-b858-a2ab529b73ee service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:37.573526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df685e-b93c-4531-b858-a2ab529b73ee service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:37.573802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df685e-b93c-4531-b858-a2ab529b73ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:37.575485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-46df685e-b93c-4531-b858-a2ab529b73ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:37.679484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df685e-b93c-4531-b858-a2ab529b73ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:37.681071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df685e-b93c-4531-b858-a2ab529b73ee service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:37.702933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 698/1406] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:39.771108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14158b3-74bd-47e5-ad42-83213b05e541 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:39.771772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14158b3-74bd-47e5-ad42-83213b05e541 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:39.771772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14158b3-74bd-47e5-ad42-83213b05e541 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:39.773230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 709/1407] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:39.778684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad375-0a77-4501-8bd4-3ce9231bb770 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:39.779149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad375-0a77-4501-8bd4-3ce9231bb770 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:39.779240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad375-0a77-4501-8bd4-3ce9231bb770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:39.859433 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2e7ad375-0a77-4501-8bd4-3ce9231bb770 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:39.861492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2e7ad375-0a77-4501-8bd4-3ce9231bb770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:39.892731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:39.971068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 699/1408] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:40.015139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14158b3-74bd-47e5-ad42-83213b05e541 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:40.016704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c14158b3-74bd-47e5-ad42-83213b05e541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:40.180477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14158b3-74bd-47e5-ad42-83213b05e541 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:40.199649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:40.340996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8347-a179-49b4-b97b-44cddb03a2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:40.341982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8347-a179-49b4-b97b-44cddb03a2f7 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:40.342339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8347-a179-49b4-b97b-44cddb03a2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:40.342618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8347-a179-49b4-b97b-44cddb03a2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:40.344397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-16ca8347-a179-49b4-b97b-44cddb03a2f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:40.457578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8347-a179-49b4-b97b-44cddb03a2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:40.459195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8347-a179-49b4-b97b-44cddb03a2f7 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:40.485918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 710/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:25:49.969120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=31 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:50.482894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:57.576542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff98269-df52-4f97-a84a-3d5c02e57c8e None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:57.577155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff98269-df52-4f97-a84a-3d5c02e57c8e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:57.577155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff98269-df52-4f97-a84a-3d5c02e57c8e None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:57.578479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 700/1410] 10.222.0.58 () {54 vars in 918 bytes} [Thu Jul 28 06:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:57.583662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afda6b-d8f4-494a-96a9-3ce0db7e12bf None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:57.584097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afda6b-d8f4-494a-96a9-3ce0db7e12bf None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:57.584199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afda6b-d8f4-494a-96a9-3ce0db7e12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:57.668784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-27afda6b-d8f4-494a-96a9-3ce0db7e12bf None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:57.670001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-27afda6b-d8f4-494a-96a9-3ce0db7e12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:57.801186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 711/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Jul 28 06:25:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:57.822655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb2aa4-5f85-4a92-8614-3907033c5439 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:57.822941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb2aa4-5f85-4a92-8614-3907033c5439 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:57.823216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb2aa4-5f85-4a92-8614-3907033c5439 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:57.824610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 701/1412] 10.222.0.58 () {54 vars in 918 bytes} [Thu Jul 28 06:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:25:57.829510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcd89-2ab7-4527-baa9-6a17c2803d3d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:57.829737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcd89-2ab7-4527-baa9-6a17c2803d3d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:57.830036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcd89-2ab7-4527-baa9-6a17c2803d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:57.905548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:57.909614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-73cbcd89-2ab7-4527-baa9-6a17c2803d3d None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:57.911524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-73cbcd89-2ab7-4527-baa9-6a17c2803d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:58.035228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 712/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Jul 28 06:25:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:00.491278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9b782-880e-4893-aee2-6ff382a83944 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:00.492223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9b782-880e-4893-aee2-6ff382a83944 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:00.492223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9b782-880e-4893-aee2-6ff382a83944 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:00.494155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:00.499506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660381c4-9edc-4ebf-8041-b84708c7d5fc None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:00.499957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660381c4-9edc-4ebf-8041-b84708c7d5fc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:00.500074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660381c4-9edc-4ebf-8041-b84708c7d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:00.566363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-660381c4-9edc-4ebf-8041-b84708c7d5fc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:00.567565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-660381c4-9edc-4ebf-8041-b84708c7d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:00.625483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:00.667976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:00.714939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9b782-880e-4893-aee2-6ff382a83944 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:00.717434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cca9b782-880e-4893-aee2-6ff382a83944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:00.881926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9b782-880e-4893-aee2-6ff382a83944 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:00.958897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:00.999572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87023631-1005-4203-ba1d-f9d18897bb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:01.000240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87023631-1005-4203-ba1d-f9d18897bb99 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:01.000526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87023631-1005-4203-ba1d-f9d18897bb99 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:01.000798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87023631-1005-4203-ba1d-f9d18897bb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:01.002430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-87023631-1005-4203-ba1d-f9d18897bb99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:01.096338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87023631-1005-4203-ba1d-f9d18897bb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:01.097952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87023631-1005-4203-ba1d-f9d18897bb99 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:01.116203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 703/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:02.026406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d792e-8718-4da8-9b7c-f07b47980fa7 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:02.026825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d792e-8718-4da8-9b7c-f07b47980fa7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:02.026949 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d792e-8718-4da8-9b7c-f07b47980fa7 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:02.028568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:02.034481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cdb65-5585-4d02-918c-cd024f4f89d9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:02.034950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cdb65-5585-4d02-918c-cd024f4f89d9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:02.035054 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cdb65-5585-4d02-918c-cd024f4f89d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:02.114470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e91cdb65-5585-4d02-918c-cd024f4f89d9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:02.115662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e91cdb65-5585-4d02-918c-cd024f4f89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:02.142692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:02.216934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:02.394003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d792e-8718-4da8-9b7c-f07b47980fa7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:02.396522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b92d792e-8718-4da8-9b7c-f07b47980fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:02.578764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d792e-8718-4da8-9b7c-f07b47980fa7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:02.623630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:02.705738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d86e0d-1e33-44a2-a229-9cd4848b4d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:02.706362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d86e0d-1e33-44a2-a229-9cd4848b4d05 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:02.706643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d86e0d-1e33-44a2-a229-9cd4848b4d05 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:02.706917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d86e0d-1e33-44a2-a229-9cd4848b4d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:02.708598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e1d86e0d-1e33-44a2-a229-9cd4848b4d05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:02.805043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d86e0d-1e33-44a2-a229-9cd4848b4d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:02.806647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d86e0d-1e33-44a2-a229-9cd4848b4d05 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:02.826233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 715/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:03.698425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924017e-9765-461b-956b-0d305cd60718 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:03.699050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924017e-9765-461b-956b-0d305cd60718 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:03.699050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924017e-9765-461b-956b-0d305cd60718 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:03.700362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:03.706437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e726b8c-14da-4254-ac94-4ddceb0c1fe4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:03.707159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e726b8c-14da-4254-ac94-4ddceb0c1fe4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:03.707354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e726b8c-14da-4254-ac94-4ddceb0c1fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:03.772822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:03.801065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5e726b8c-14da-4254-ac94-4ddceb0c1fe4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:03.802281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5e726b8c-14da-4254-ac94-4ddceb0c1fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:03.921500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:04.075772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924017e-9765-461b-956b-0d305cd60718 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:04.077976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6924017e-9765-461b-956b-0d305cd60718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:04.248612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924017e-9765-461b-956b-0d305cd60718 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:04.261629 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:04.381862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4f49a-b42f-4262-8ce5-8140b476288d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:04.382497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f49a-b42f-4262-8ce5-8140b476288d service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:04.382775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f49a-b42f-4262-8ce5-8140b476288d service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:04.383059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f49a-b42f-4262-8ce5-8140b476288d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:04.384821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7cc4f49a-b42f-4262-8ce5-8140b476288d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:04.479265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4f49a-b42f-4262-8ce5-8140b476288d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:04.481069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4f49a-b42f-4262-8ce5-8140b476288d service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:04.499811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 706/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:05.364207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bb77f-5160-443e-be53-0040e28b71ec None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:05.364777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bb77f-5160-443e-be53-0040e28b71ec None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:05.364777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bb77f-5160-443e-be53-0040e28b71ec None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:05.366059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:05.372001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b1de-6d40-4316-8832-ec60f8efc6d3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:05.372579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b1de-6d40-4316-8832-ec60f8efc6d3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:05.372579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b1de-6d40-4316-8832-ec60f8efc6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:05.394015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:05.466078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-97c5b1de-6d40-4316-8832-ec60f8efc6d3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:05.467305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-97c5b1de-6d40-4316-8832-ec60f8efc6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:05.572106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:05.724589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bb77f-5160-443e-be53-0040e28b71ec None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:05.727088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-628bb77f-5160-443e-be53-0040e28b71ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:05.861115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:05.899544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bb77f-5160-443e-be53-0040e28b71ec None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:06.030151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43238947-c39a-4ec2-8504-737d7c9be569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:06.031277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43238947-c39a-4ec2-8504-737d7c9be569 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:06.031277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43238947-c39a-4ec2-8504-737d7c9be569 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:06.031479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43238947-c39a-4ec2-8504-737d7c9be569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:06.034047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-43238947-c39a-4ec2-8504-737d7c9be569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:06.134598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:06.149040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43238947-c39a-4ec2-8504-737d7c9be569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:06.150643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43238947-c39a-4ec2-8504-737d7c9be569 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:06.170089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 718/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:07.021001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05793feb-3fab-453d-95a8-2afc7b24ceb3 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:07.021554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05793feb-3fab-453d-95a8-2afc7b24ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:07.021554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05793feb-3fab-453d-95a8-2afc7b24ceb3 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:07.023550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:07.029207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd300-f220-4407-8f95-788d2444b68e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:07.029638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd300-f220-4407-8f95-788d2444b68e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:07.029901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd300-f220-4407-8f95-788d2444b68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:07.107919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-235fd300-f220-4407-8f95-788d2444b68e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:07.109123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-235fd300-f220-4407-8f95-788d2444b68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:07.219760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:07.372241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05793feb-3fab-453d-95a8-2afc7b24ceb3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:07.374563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-05793feb-3fab-453d-95a8-2afc7b24ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:07.474434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:07.555356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05793feb-3fab-453d-95a8-2afc7b24ceb3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:07.672603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b03d9-5841-4c09-b92b-d2b2d12f0096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:07.673149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b03d9-5841-4c09-b92b-d2b2d12f0096 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:07.673429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b03d9-5841-4c09-b92b-d2b2d12f0096 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:07.673677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b03d9-5841-4c09-b92b-d2b2d12f0096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:07.675294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-185b03d9-5841-4c09-b92b-d2b2d12f0096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:07.727666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:07.776426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b03d9-5841-4c09-b92b-d2b2d12f0096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:07.778137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b03d9-5841-4c09-b92b-d2b2d12f0096 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:07.800650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 709/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:08.623179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4901-7c5b-4221-82f1-15c5aa1e6a1c None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:08.623850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4901-7c5b-4221-82f1-15c5aa1e6a1c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:08.623850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4901-7c5b-4221-82f1-15c5aa1e6a1c None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:08.625157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:08.630660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f277e4c-d728-4af1-8160-7e0bf0602545 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:08.631103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f277e4c-d728-4af1-8160-7e0bf0602545 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:08.631208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f277e4c-d728-4af1-8160-7e0bf0602545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:08.724847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2f277e4c-d728-4af1-8160-7e0bf0602545 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:08.726099 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2f277e4c-d728-4af1-8160-7e0bf0602545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:08.829831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:08.986588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a4901-7c5b-4221-82f1-15c5aa1e6a1c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:08.989108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-512a4901-7c5b-4221-82f1-15c5aa1e6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:09.049537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:09.152327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a4901-7c5b-4221-82f1-15c5aa1e6a1c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:09.278259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ec9f0-79c3-4e39-90dc-dd7eb947db75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:09.278788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec9f0-79c3-4e39-90dc-dd7eb947db75 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:09.279067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec9f0-79c3-4e39-90dc-dd7eb947db75 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:09.279339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec9f0-79c3-4e39-90dc-dd7eb947db75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:09.281121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fa8ec9f0-79c3-4e39-90dc-dd7eb947db75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:09.288295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:09.380741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ec9f0-79c3-4e39-90dc-dd7eb947db75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:09.382354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ec9f0-79c3-4e39-90dc-dd7eb947db75 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:09.404637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 721/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:10.222547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07554-bb3c-47e5-8653-c09dff282839 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:10.223141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07554-bb3c-47e5-8653-c09dff282839 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:10.223141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07554-bb3c-47e5-8653-c09dff282839 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:10.224524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:10.230686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531ebc-9d4d-43c1-938d-712844709709 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:10.231213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531ebc-9d4d-43c1-938d-712844709709 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:10.231369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531ebc-9d4d-43c1-938d-712844709709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:10.314982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-9d531ebc-9d4d-43c1-938d-712844709709 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:10.316233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9d531ebc-9d4d-43c1-938d-712844709709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:10.390155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:10.421601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:10.575698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07554-bb3c-47e5-8653-c09dff282839 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:10.577938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-12f07554-bb3c-47e5-8653-c09dff282839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:10.606826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:10.743334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07554-bb3c-47e5-8653-c09dff282839 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:10.839851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:10.866484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a023e9-2b57-4cea-a297-addb80e6ff2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:10.867110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a023e9-2b57-4cea-a297-addb80e6ff2c service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:10.867382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a023e9-2b57-4cea-a297-addb80e6ff2c service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:10.867685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a023e9-2b57-4cea-a297-addb80e6ff2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:10.869289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-76a023e9-2b57-4cea-a297-addb80e6ff2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:10.966381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a023e9-2b57-4cea-a297-addb80e6ff2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:10.968077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a023e9-2b57-4cea-a297-addb80e6ff2c service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:10.991459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 712/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:11.804988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ec82-7d79-4895-bced-6ddf5e293d78 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:11.805590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ec82-7d79-4895-bced-6ddf5e293d78 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:11.805590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ec82-7d79-4895-bced-6ddf5e293d78 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:11.806891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:11.812380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176c6ce-8a96-4a40-a1c5-39c27b72af7f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:11.812870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176c6ce-8a96-4a40-a1c5-39c27b72af7f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:11.812968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176c6ce-8a96-4a40-a1c5-39c27b72af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:11.890963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-9176c6ce-8a96-4a40-a1c5-39c27b72af7f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:11.892210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9176c6ce-8a96-4a40-a1c5-39c27b72af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:11.935888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:11.997648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:12.151047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9ec82-7d79-4895-bced-6ddf5e293d78 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:12.152547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0db9ec82-7d79-4895-bced-6ddf5e293d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:12.431752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9ec82-7d79-4895-bced-6ddf5e293d78 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:12.489256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:12.558575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd0149-8cfd-466f-8551-4e9906cc262c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:12.559198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd0149-8cfd-466f-8551-4e9906cc262c service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:12.559472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd0149-8cfd-466f-8551-4e9906cc262c service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:12.559768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd0149-8cfd-466f-8551-4e9906cc262c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:12.562050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ddfd0149-8cfd-466f-8551-4e9906cc262c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:12.664535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd0149-8cfd-466f-8551-4e9906cc262c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:12.666109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd0149-8cfd-466f-8551-4e9906cc262c service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:12.684224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 724/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:13.490599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88dc58-76e6-4389-a05f-6326880cccc0 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:13.491158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88dc58-76e6-4389-a05f-6326880cccc0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:13.491158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88dc58-76e6-4389-a05f-6326880cccc0 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:13.492548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:13.498670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98a63-d07f-44a7-9606-687cc0ce183c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:13.499111 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98a63-d07f-44a7-9606-687cc0ce183c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:13.499226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98a63-d07f-44a7-9606-687cc0ce183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:13.581471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-9bc98a63-d07f-44a7-9606-687cc0ce183c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:13.582688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9bc98a63-d07f-44a7-9606-687cc0ce183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:13.584801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:13.685342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:13.843104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88dc58-76e6-4389-a05f-6326880cccc0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:13.844661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3d88dc58-76e6-4389-a05f-6326880cccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:14.001563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88dc58-76e6-4389-a05f-6326880cccc0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:14.030991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:14.121776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196acc5a-528d-4439-9ab1-cf19768705d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:14.122437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196acc5a-528d-4439-9ab1-cf19768705d1 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:14.122716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196acc5a-528d-4439-9ab1-cf19768705d1 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:14.123009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196acc5a-528d-4439-9ab1-cf19768705d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:14.124810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-196acc5a-528d-4439-9ab1-cf19768705d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:14.237876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196acc5a-528d-4439-9ab1-cf19768705d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:14.239419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196acc5a-528d-4439-9ab1-cf19768705d1 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:14.261969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 715/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:16.201975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a535c4-65f4-43be-a891-34ca8c6948af None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:16.202505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a535c4-65f4-43be-a891-34ca8c6948af None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:16.202505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a535c4-65f4-43be-a891-34ca8c6948af None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:16.203946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:16.209209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866726d8-ca8d-400a-8867-1cdd0402d329 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:16.209662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866726d8-ca8d-400a-8867-1cdd0402d329 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:16.209791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866726d8-ca8d-400a-8867-1cdd0402d329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:16.256586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:16.283133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-866726d8-ca8d-400a-8867-1cdd0402d329 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:16.284369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-866726d8-ca8d-400a-8867-1cdd0402d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:16.388711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:16.430925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a535c4-65f4-43be-a891-34ca8c6948af None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:16.433570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d4a535c4-65f4-43be-a891-34ca8c6948af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:16.558348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a535c4-65f4-43be-a891-34ca8c6948af None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:16.592268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:16.638980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd6f80-b09f-46d4-8eca-c3276d8dd5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:16.640018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd6f80-b09f-46d4-8eca-c3276d8dd5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:16.640366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd6f80-b09f-46d4-8eca-c3276d8dd5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:16.640800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd6f80-b09f-46d4-8eca-c3276d8dd5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:16.643426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-facd6f80-b09f-46d4-8eca-c3276d8dd5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:16.756922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd6f80-b09f-46d4-8eca-c3276d8dd5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:16.758382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd6f80-b09f-46d4-8eca-c3276d8dd5c5 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:16.776625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 727/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:18.900161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1cf09-473d-462e-8f51-e06eec183031 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:18.900800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1cf09-473d-462e-8f51-e06eec183031 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:18.900800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1cf09-473d-462e-8f51-e06eec183031 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:18.902092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:18.910934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5778de-37df-46b8-8594-8048b756d5a6 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:18.911394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5778de-37df-46b8-8594-8048b756d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:18.911505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5778de-37df-46b8-8594-8048b756d5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:18.989597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0c5778de-37df-46b8-8594-8048b756d5a6 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:18.990847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0c5778de-37df-46b8-8594-8048b756d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:19.004224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:19.091472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:19.141625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1cf09-473d-462e-8f51-e06eec183031 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:19.143980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-66b1cf09-473d-462e-8f51-e06eec183031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:19.254928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1cf09-473d-462e-8f51-e06eec183031 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:19.267201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:19.333406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c461fc-6936-4b35-a03c-b86d8bae33a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:19.334023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c461fc-6936-4b35-a03c-b86d8bae33a6 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:19.334297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c461fc-6936-4b35-a03c-b86d8bae33a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:19.334561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c461fc-6936-4b35-a03c-b86d8bae33a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:19.336202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d5c461fc-6936-4b35-a03c-b86d8bae33a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:19.469175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c461fc-6936-4b35-a03c-b86d8bae33a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:19.470628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c461fc-6936-4b35-a03c-b86d8bae33a6 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:19.489454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 718/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:21.901984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936449a5-d93a-40f2-a5fb-1e4202b375b2 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:21.902581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936449a5-d93a-40f2-a5fb-1e4202b375b2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:21.902581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936449a5-d93a-40f2-a5fb-1e4202b375b2 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:21.904283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:21.910167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17cb5-77a6-4b8c-af82-7c4cc4c6cd65 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:21.910660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17cb5-77a6-4b8c-af82-7c4cc4c6cd65 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:21.910660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17cb5-77a6-4b8c-af82-7c4cc4c6cd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:21.961494 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:21.980454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-35d17cb5-77a6-4b8c-af82-7c4cc4c6cd65 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:21.981694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-35d17cb5-77a6-4b8c-af82-7c4cc4c6cd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:22.088978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:26:22.132135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936449a5-d93a-40f2-a5fb-1e4202b375b2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:22.136872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-936449a5-d93a-40f2-a5fb-1e4202b375b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:22.261527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936449a5-d93a-40f2-a5fb-1e4202b375b2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:22.302886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:22.339117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ed24c-0f7d-4549-bfee-b3a0b8a60eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:22.339781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed24c-0f7d-4549-bfee-b3a0b8a60eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:22.340080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed24c-0f7d-4549-bfee-b3a0b8a60eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:22.340353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed24c-0f7d-4549-bfee-b3a0b8a60eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:22.341969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a33ed24c-0f7d-4549-bfee-b3a0b8a60eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:22.467275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ed24c-0f7d-4549-bfee-b3a0b8a60eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:22.468767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ed24c-0f7d-4549-bfee-b3a0b8a60eb2 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:22.488284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 730/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:24.617034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92876e-4315-49f7-8b8a-47d223189088 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:24.617637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92876e-4315-49f7-8b8a-47d223189088 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:24.617637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92876e-4315-49f7-8b8a-47d223189088 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:24.618960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:24.625455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101dc33-8bf9-49bb-a17c-1f50a2adb2ec None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:24.626205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101dc33-8bf9-49bb-a17c-1f50a2adb2ec None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:24.626403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101dc33-8bf9-49bb-a17c-1f50a2adb2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:24.699641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3101dc33-8bf9-49bb-a17c-1f50a2adb2ec None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:24.700979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3101dc33-8bf9-49bb-a17c-1f50a2adb2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:24.724572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:24.809166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:24.848838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92876e-4315-49f7-8b8a-47d223189088 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:24.851172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6f92876e-4315-49f7-8b8a-47d223189088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:24.966992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92876e-4315-49f7-8b8a-47d223189088 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:24.989567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:25.046493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271721-a50c-48d1-9a2f-1b703b63ea04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:25.047222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271721-a50c-48d1-9a2f-1b703b63ea04 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:25.047481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271721-a50c-48d1-9a2f-1b703b63ea04 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:25.047805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271721-a50c-48d1-9a2f-1b703b63ea04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:25.049436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-62271721-a50c-48d1-9a2f-1b703b63ea04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:25.165073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271721-a50c-48d1-9a2f-1b703b63ea04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:25.166534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271721-a50c-48d1-9a2f-1b703b63ea04 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:25.184759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 721/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:27.235978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9152b5-a082-45f3-b101-8bb87d10a061 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:27.236558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9152b5-a082-45f3-b101-8bb87d10a061 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:27.236558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9152b5-a082-45f3-b101-8bb87d10a061 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:27.238440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:27.244243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f1cd7-a46f-4798-80aa-d8e042cf5496 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:27.244651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f1cd7-a46f-4798-80aa-d8e042cf5496 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:27.244795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f1cd7-a46f-4798-80aa-d8e042cf5496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:27.317914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:27.321022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f95f1cd7-a46f-4798-80aa-d8e042cf5496 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:27.323012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f95f1cd7-a46f-4798-80aa-d8e042cf5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:27.425775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:27.466998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9152b5-a082-45f3-b101-8bb87d10a061 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:27.468575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2e9152b5-a082-45f3-b101-8bb87d10a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:27.577383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9152b5-a082-45f3-b101-8bb87d10a061 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:27.626299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:27.651561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1969543-be23-4055-987c-2f99c2f6d9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:27.652230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1969543-be23-4055-987c-2f99c2f6d9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:27.652506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1969543-be23-4055-987c-2f99c2f6d9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:27.652771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1969543-be23-4055-987c-2f99c2f6d9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:27.654419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d1969543-be23-4055-987c-2f99c2f6d9e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:27.764980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1969543-be23-4055-987c-2f99c2f6d9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:27.766405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1969543-be23-4055-987c-2f99c2f6d9e3 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:27.783613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 733/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:29.823473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33876de-d417-406f-a0a6-e976cfe89a59 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:29.824459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33876de-d417-406f-a0a6-e976cfe89a59 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:29.824459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33876de-d417-406f-a0a6-e976cfe89a59 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:29.826370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:29.832648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea0b9c-a372-4dcb-bb49-1a1feba12cfb None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:29.833122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea0b9c-a372-4dcb-bb49-1a1feba12cfb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:29.833218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea0b9c-a372-4dcb-bb49-1a1feba12cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:29.909990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-caea0b9c-a372-4dcb-bb49-1a1feba12cfb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:29.911576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-caea0b9c-a372-4dcb-bb49-1a1feba12cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:29.943434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:30.021310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:30.059515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33876de-d417-406f-a0a6-e976cfe89a59 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:30.061434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b33876de-d417-406f-a0a6-e976cfe89a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:30.171611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33876de-d417-406f-a0a6-e976cfe89a59 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:30.203403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:30.255968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdd14f-5ffa-4d4a-9813-6dcaeb0c4d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:30.256603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd14f-5ffa-4d4a-9813-6dcaeb0c4d4c service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:30.256896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd14f-5ffa-4d4a-9813-6dcaeb0c4d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:30.257143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd14f-5ffa-4d4a-9813-6dcaeb0c4d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:30.258763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-29fdd14f-5ffa-4d4a-9813-6dcaeb0c4d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:30.392313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdd14f-5ffa-4d4a-9813-6dcaeb0c4d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:30.393803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdd14f-5ffa-4d4a-9813-6dcaeb0c4d4c service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:30.412528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 724/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:32.440872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cffd-7e4c-441e-99dc-2a986834eec8 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:32.441720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cffd-7e4c-441e-99dc-2a986834eec8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:32.441720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cffd-7e4c-441e-99dc-2a986834eec8 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:32.443797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:32.452637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e441d-0e15-41aa-8c68-c2f0214fe46c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:32.453061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e441d-0e15-41aa-8c68-c2f0214fe46c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:32.453225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e441d-0e15-41aa-8c68-c2f0214fe46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:32.526423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cc4e441d-0e15-41aa-8c68-c2f0214fe46c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:32.527648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cc4e441d-0e15-41aa-8c68-c2f0214fe46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:32.536565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:32.629286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:32.669091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84cffd-7e4c-441e-99dc-2a986834eec8 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:32.670628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5d84cffd-7e4c-441e-99dc-2a986834eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:32.781023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84cffd-7e4c-441e-99dc-2a986834eec8 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:32.837084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:32.856872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49380-97c5-4730-8060-402f2ae9b2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:32.857534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49380-97c5-4730-8060-402f2ae9b2da service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:32.857807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49380-97c5-4730-8060-402f2ae9b2da service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:32.858077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49380-97c5-4730-8060-402f2ae9b2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:32.859709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9ed49380-97c5-4730-8060-402f2ae9b2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:32.973825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49380-97c5-4730-8060-402f2ae9b2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:32.975242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49380-97c5-4730-8060-402f2ae9b2da service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:32.993479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 736/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:35.045391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c897a-6ba6-4d0c-8eff-76ef3cac9875 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:35.045896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c897a-6ba6-4d0c-8eff-76ef3cac9875 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:35.045896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c897a-6ba6-4d0c-8eff-76ef3cac9875 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:35.047447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:35.053807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b03dd-d359-4122-a4e4-c78fe1154405 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:35.054245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b03dd-d359-4122-a4e4-c78fe1154405 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:35.054340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b03dd-d359-4122-a4e4-c78fe1154405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:35.129697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-970b03dd-d359-4122-a4e4-c78fe1154405 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:35.130930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-970b03dd-d359-4122-a4e4-c78fe1154405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:35.169202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:35.238096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:35.279133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c897a-6ba6-4d0c-8eff-76ef3cac9875 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:35.281533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-821c897a-6ba6-4d0c-8eff-76ef3cac9875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:35.397079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c897a-6ba6-4d0c-8eff-76ef3cac9875 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:35.436933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:35.485154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b838-5939-4c29-b218-4979d4790de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:35.485794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b838-5939-4c29-b218-4979d4790de0 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:35.486073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b838-5939-4c29-b218-4979d4790de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:35.486342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b838-5939-4c29-b218-4979d4790de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:35.488214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2423b838-5939-4c29-b218-4979d4790de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:35.611985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b838-5939-4c29-b218-4979d4790de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:35.613361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b838-5939-4c29-b218-4979d4790de0 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:35.632125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 727/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:37.652139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb7f5-26ca-4fb9-875f-bfc866853057 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:37.653073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb7f5-26ca-4fb9-875f-bfc866853057 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:37.653073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb7f5-26ca-4fb9-875f-bfc866853057 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:37.655281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:37.661742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dfc0-105e-4fbc-8326-d8c783776b7f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:37.662440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dfc0-105e-4fbc-8326-d8c783776b7f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:37.662607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dfc0-105e-4fbc-8326-d8c783776b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:37.735508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7f19dfc0-105e-4fbc-8326-d8c783776b7f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:37.736805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7f19dfc0-105e-4fbc-8326-d8c783776b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:37.756281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:37.842614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:37.881898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb7f5-26ca-4fb9-875f-bfc866853057 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:37.883445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8f4eb7f5-26ca-4fb9-875f-bfc866853057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:37.992505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb7f5-26ca-4fb9-875f-bfc866853057 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:38.062513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:38.069769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40592c0-c18b-48f5-b250-f45b54325ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:38.070454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40592c0-c18b-48f5-b250-f45b54325ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:38.070701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40592c0-c18b-48f5-b250-f45b54325ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:38.070971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40592c0-c18b-48f5-b250-f45b54325ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:38.072623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c40592c0-c18b-48f5-b250-f45b54325ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:38.196648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40592c0-c18b-48f5-b250-f45b54325ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:38.199038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40592c0-c18b-48f5-b250-f45b54325ab2 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:38.228295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 739/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:26:40.251776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8a92b-eb92-4308-a850-2d69ce3ed20e None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:40.252568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8a92b-eb92-4308-a850-2d69ce3ed20e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:40.252568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8a92b-eb92-4308-a850-2d69ce3ed20e None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:40.254782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:26:40.261683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cadc9-74c6-4b71-bc79-a39c86409d11 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:40.262406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cadc9-74c6-4b71-bc79-a39c86409d11 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:40.262541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cadc9-74c6-4b71-bc79-a39c86409d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:40.340633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-8c7cadc9-74c6-4b71-bc79-a39c86409d11 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:40.341912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8c7cadc9-74c6-4b71-bc79-a39c86409d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:40.396980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:40.447651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:40.486230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8a92b-eb92-4308-a850-2d69ce3ed20e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:40.487849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-73a8a92b-eb92-4308-a850-2d69ce3ed20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:40.601450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8a92b-eb92-4308-a850-2d69ce3ed20e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:40.653394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:40.680484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991893ba-a3e3-4784-94ff-92886f461748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:40.681101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991893ba-a3e3-4784-94ff-92886f461748 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:40.681381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991893ba-a3e3-4784-94ff-92886f461748 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:40.681649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991893ba-a3e3-4784-94ff-92886f461748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:40.683254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-991893ba-a3e3-4784-94ff-92886f461748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:40.801128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991893ba-a3e3-4784-94ff-92886f461748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:40.803231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991893ba-a3e3-4784-94ff-92886f461748 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:40.829974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 730/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:50.445748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=22 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:50.827662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=66 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:00.901136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447fa5-62cd-432c-a5d3-c7d90aa9b1a7 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:00.902091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447fa5-62cd-432c-a5d3-c7d90aa9b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:00.902091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447fa5-62cd-432c-a5d3-c7d90aa9b1a7 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:00.904273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 741/1471] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:00.909678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55887b-ce66-4d14-8eb4-e59f1d35f113 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:00.910122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55887b-ce66-4d14-8eb4-e59f1d35f113 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:00.910231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55887b-ce66-4d14-8eb4-e59f1d35f113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:00.985312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5d55887b-ce66-4d14-8eb4-e59f1d35f113 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:00.987163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5d55887b-ce66-4d14-8eb4-e59f1d35f113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:01.101388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 731/1472] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:01.188713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c794-78b4-4a53-a388-3ff720efda9f None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:01.188990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c794-78b4-4a53-a388-3ff720efda9f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:01.189257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c794-78b4-4a53-a388-3ff720efda9f None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:01.190628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 742/1473] 10.222.0.58 () {54 vars in 966 bytes} [Thu Jul 28 06:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:01.195756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a736-faef-4a12-8de8-3dd3bbccb14a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:01.196048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a736-faef-4a12-8de8-3dd3bbccb14a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:01.196325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a736-faef-4a12-8de8-3dd3bbccb14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:01.273011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-0a89a736-faef-4a12-8de8-3dd3bbccb14a None None] MFA Rules not processed for user `d1e0e81d0ee04020b43c28347ef3ab6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:01.274214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0a89a736-faef-4a12-8de8-3dd3bbccb14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:01.295750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:01.353335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 732/1474] 10.222.0.58 () {58 vars in 1063 bytes} [Thu Jul 28 06:27:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:01.361892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7c794-78b4-4a53-a388-3ff720efda9f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:27:01.364432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-57b7c794-78b4-4a53-a388-3ff720efda9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:01.479192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7c794-78b4-4a53-a388-3ff720efda9f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:27:01.558606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7aaa2-a1d7-4d10-9dde-c469f8d250d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1e0e81d0ee04020b43c28347ef3ab6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:27:01.559233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aaa2-a1d7-4d10-9dde-c469f8d250d8 service glance] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:01.559511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aaa2-a1d7-4d10-9dde-c469f8d250d8 service glance] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:01.559820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aaa2-a1d7-4d10-9dde-c469f8d250d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:01.561460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bea7aaa2-a1d7-4d10-9dde-c469f8d250d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:01.615926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:01.669524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7aaa2-a1d7-4d10-9dde-c469f8d250d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:27:01.671037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7aaa2-a1d7-4d10-9dde-c469f8d250d8 service glance] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:27:01.696169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 743/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:27:03.785006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511421-9a54-480e-8c90-80e10f69b72f None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:03.785622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511421-9a54-480e-8c90-80e10f69b72f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:03.785622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511421-9a54-480e-8c90-80e10f69b72f None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:03.786910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 733/1476] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:03.793518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca2b8e-ff63-41d5-8888-f688886eaf75 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:03.794247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca2b8e-ff63-41d5-8888-f688886eaf75 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:03.794436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca2b8e-ff63-41d5-8888-f688886eaf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:03.865377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-dcca2b8e-ff63-41d5-8888-f688886eaf75 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:03.866590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dcca2b8e-ff63-41d5-8888-f688886eaf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:03.968828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 744/1477] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:03.997344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce511421-9a54-480e-8c90-80e10f69b72f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:27:03.998875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ce511421-9a54-480e-8c90-80e10f69b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:04.140638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce511421-9a54-480e-8c90-80e10f69b72f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:27:04.196180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:04.246530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71970f-66f7-4a98-8b06-e82bfea8b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:27:04.247156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71970f-66f7-4a98-8b06-e82bfea8b662 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:04.247437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71970f-66f7-4a98-8b06-e82bfea8b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:04.247738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71970f-66f7-4a98-8b06-e82bfea8b662 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:04.248524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71970f-66f7-4a98-8b06-e82bfea8b662 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:27:04.250318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-dd71970f-66f7-4a98-8b06-e82bfea8b662 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:27:04.250318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:27:04.250318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:27:04.251455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71970f-66f7-4a98-8b06-e82bfea8b662 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:27:04.270153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 734/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Jul 28 06:27:03 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:27:06.266298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97431ba-4e7c-4195-826c-927cdc32479d None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:06.267184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97431ba-4e7c-4195-826c-927cdc32479d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:06.267184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97431ba-4e7c-4195-826c-927cdc32479d None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:06.269290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 745/1479] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:27:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:06.277906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a4f32-6461-4ad5-a6e9-bc22afb4a2a6 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:06.278326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a4f32-6461-4ad5-a6e9-bc22afb4a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:06.278498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a4f32-6461-4ad5-a6e9-bc22afb4a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:06.353814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-652a4f32-6461-4ad5-a6e9-bc22afb4a2a6 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:06.355030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-652a4f32-6461-4ad5-a6e9-bc22afb4a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:06.454849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 735/1480] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:06.504512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97431ba-4e7c-4195-826c-927cdc32479d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:27:06.505999 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e97431ba-4e7c-4195-826c-927cdc32479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:06.516004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:06.654638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97431ba-4e7c-4195-826c-927cdc32479d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:27:06.736726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:06.771095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e180c2-6b36-4e15-922c-722ddf2d1308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:27:06.771754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e180c2-6b36-4e15-922c-722ddf2d1308 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:06.772030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e180c2-6b36-4e15-922c-722ddf2d1308 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:06.772302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e180c2-6b36-4e15-922c-722ddf2d1308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:06.773913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-19e180c2-6b36-4e15-922c-722ddf2d1308 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:06.868073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e180c2-6b36-4e15-922c-722ddf2d1308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:27:06.869658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e180c2-6b36-4e15-922c-722ddf2d1308 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:27:06.888108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 746/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:27:09.065506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e8299-0ca1-41c3-8487-d96afc739ad8 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:09.066034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e8299-0ca1-41c3-8487-d96afc739ad8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:09.066034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e8299-0ca1-41c3-8487-d96afc739ad8 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:09.067415 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 736/1482] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:09.073102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6f06-dc61-40fb-9d64-686b42b5c73b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:09.073524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6f06-dc61-40fb-9d64-686b42b5c73b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:09.073651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6f06-dc61-40fb-9d64-686b42b5c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:09.142822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-75ee6f06-dc61-40fb-9d64-686b42b5c73b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:09.144071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-75ee6f06-dc61-40fb-9d64-686b42b5c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:09.193610 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:09.248475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 747/1483] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:09.291008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e8299-0ca1-41c3-8487-d96afc739ad8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:27:09.292623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c36e8299-0ca1-41c3-8487-d96afc739ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:09.318332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:09.403770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e8299-0ca1-41c3-8487-d96afc739ad8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:27:09.480437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3d1f5-8ab1-4c41-9ba8-022faca543d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:27:09.481054 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3d1f5-8ab1-4c41-9ba8-022faca543d3 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:09.481331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3d1f5-8ab1-4c41-9ba8-022faca543d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:09.481596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3d1f5-8ab1-4c41-9ba8-022faca543d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:09.483228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-01a3d1f5-8ab1-4c41-9ba8-022faca543d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:09.564751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:09.601335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3d1f5-8ab1-4c41-9ba8-022faca543d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:27:09.602790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3d1f5-8ab1-4c41-9ba8-022faca543d3 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:27:09.625058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 737/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:27:11.745333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746185f-b315-44ec-9843-4a746ffdd042 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:11.745922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746185f-b315-44ec-9843-4a746ffdd042 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:11.745922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746185f-b315-44ec-9843-4a746ffdd042 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:11.747245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 748/1485] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:11.753795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b31543-c85c-4209-906e-9c402802a147 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:11.754269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b31543-c85c-4209-906e-9c402802a147 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:11.754405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b31543-c85c-4209-906e-9c402802a147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:11.953456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-58b31543-c85c-4209-906e-9c402802a147 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:11.954695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-58b31543-c85c-4209-906e-9c402802a147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:12.061955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 738/1486] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:12.105566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746185f-b315-44ec-9843-4a746ffdd042 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:27:12.108062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a746185f-b315-44ec-9843-4a746ffdd042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:12.228444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746185f-b315-44ec-9843-4a746ffdd042 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:27:12.309029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:12.310827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d169b99-b056-45cb-8fd8-a8d601342a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:27:12.311597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169b99-b056-45cb-8fd8-a8d601342a50 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:12.311938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169b99-b056-45cb-8fd8-a8d601342a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:12.312221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169b99-b056-45cb-8fd8-a8d601342a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:12.315066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4d169b99-b056-45cb-8fd8-a8d601342a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:12.428239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d169b99-b056-45cb-8fd8-a8d601342a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:27:12.429662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d169b99-b056-45cb-8fd8-a8d601342a50 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:27:12.454210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 749/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:27:14.629175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e487-1a2d-48ef-98d0-d3da782ca5c8 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:14.629751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e487-1a2d-48ef-98d0-d3da782ca5c8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:14.629751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e487-1a2d-48ef-98d0-d3da782ca5c8 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:14.631080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 739/1488] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:14.637331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaad7c-3018-479c-9a19-60f9a5e48af3 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:14.638022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaad7c-3018-479c-9a19-60f9a5e48af3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:14.638217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaad7c-3018-479c-9a19-60f9a5e48af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:14.715912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-feaaad7c-3018-479c-9a19-60f9a5e48af3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:14.717124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-feaaad7c-3018-479c-9a19-60f9a5e48af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:14.777505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:14.834257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 750/1489] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:14.877704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1e487-1a2d-48ef-98d0-d3da782ca5c8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:27:14.879253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-70a1e487-1a2d-48ef-98d0-d3da782ca5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:14.918349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:14.989444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1e487-1a2d-48ef-98d0-d3da782ca5c8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:27:15.067603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23f407-1103-4143-8f5f-85606ac24c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:27:15.068247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23f407-1103-4143-8f5f-85606ac24c48 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:15.068523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23f407-1103-4143-8f5f-85606ac24c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:15.068790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23f407-1103-4143-8f5f-85606ac24c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:15.070412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-be23f407-1103-4143-8f5f-85606ac24c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:15.160171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:15.193004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23f407-1103-4143-8f5f-85606ac24c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:27:15.194448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23f407-1103-4143-8f5f-85606ac24c48 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:27:15.212778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 740/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:27:17.407312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ead91-7da2-42ea-bc4c-7bdc2c497b29 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:17.408229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ead91-7da2-42ea-bc4c-7bdc2c497b29 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:17.408229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ead91-7da2-42ea-bc4c-7bdc2c497b29 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:17.411255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 751/1491] 10.222.0.58 () {54 vars in 926 bytes} [Thu Jul 28 06:27:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:27:17.420204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc8ea-091c-494e-bbc4-41dc8d33264e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:17.420670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc8ea-091c-494e-bbc4-41dc8d33264e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:17.420806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc8ea-091c-494e-bbc4-41dc8d33264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:17.496843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-48ccc8ea-091c-494e-bbc4-41dc8d33264e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:27:17.498068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-48ccc8ea-091c-494e-bbc4-41dc8d33264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:17.605368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 741/1492] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Jul 28 06:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:27:17.655076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ead91-7da2-42ea-bc4c-7bdc2c497b29 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:27:17.656649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-254ead91-7da2-42ea-bc4c-7bdc2c497b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:17.777702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ead91-7da2-42ea-bc4c-7bdc2c497b29 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:27:17.854753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730bc05-9ac8-41d3-8fdf-9a1b1492a7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:27:17.855379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730bc05-9ac8-41d3-8fdf-9a1b1492a7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:27:17.855662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730bc05-9ac8-41d3-8fdf-9a1b1492a7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:27:17.855975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730bc05-9ac8-41d3-8fdf-9a1b1492a7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:27:17.857595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4730bc05-9ac8-41d3-8fdf-9a1b1492a7d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:27:17.867074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:17.979532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730bc05-9ac8-41d3-8fdf-9a1b1492a7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:27:17.981006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730bc05-9ac8-41d3-8fdf-9a1b1492a7d8 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:27:18.000047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 752/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:27:27.603527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=82 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:27:27.998081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=50 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:02.852767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:02.853408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:02.853408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:02.931574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:02.932820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:03.036438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 742/1494] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:03.044869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36b2ab-1a5a-4083-bcb4-152af5c58a9d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:03.045357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36b2ab-1a5a-4083-bcb4-152af5c58a9d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:03.045357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36b2ab-1a5a-4083-bcb4-152af5c58a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:03.123719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1d36b2ab-1a5a-4083-bcb4-152af5c58a9d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:03.124849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1d36b2ab-1a5a-4083-bcb4-152af5c58a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:03.224587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 753/1495] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:03.229388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:03.230594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:03.242784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcd777-b19c-4d6c-a5be-3b5769f0d7db None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:03.310817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:03.345571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:03.346206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:03.346486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:03.346759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:03.347451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:29:03.347795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:03.348834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:03.348834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:29:03.348834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:29:03.349745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:03.361852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 743/1496] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:29:03.370493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36b2ab-1a5a-4083-bcb4-152af5c58a9d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:03.380741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36b2ab-1a5a-4083-bcb4-152af5c58a9d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:03.444824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:03.480124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:03.480735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:03.481011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:03.481277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:03.481961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:03.483790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING py.warnings [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:03.483790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: warnings.warn(msg) Jul 28 06:29:03.483790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: Jul 28 06:29:03.485014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:03.551177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 754/1497] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:03 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:03.555487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:03.557111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:03.593488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14e14-ec80-4d19-830e-c4a79d31fbcc admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:03.698659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:03.699199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:03.699475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:03.699776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:03.700421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:03.701452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:03.701452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:29:03.701452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:29:03.702648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:03.747434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 744/1498] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:03 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:03.751767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:03.753391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:03.822203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657a2b-200f-4e8d-b821-f919df82ba99 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:03.915161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:03.930418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:03.931056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:03.931330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:03.931595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:03.932320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:03.933346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING py.warnings [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:03.933346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: warnings.warn(msg) Jul 28 06:29:03.933346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: Jul 28 06:29:03.934233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:03.949793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 755/1499] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:29:03.953854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:03.956015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:03.969974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6458-0869-46ed-aa94-e94b0e92af80 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:03.999799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:04.076196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201c616-0afe-43d9-97f2-2030edf9322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:04.076819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201c616-0afe-43d9-97f2-2030edf9322a admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:04.077099 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201c616-0afe-43d9-97f2-2030edf9322a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:04.077371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201c616-0afe-43d9-97f2-2030edf9322a admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:04.078062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201c616-0afe-43d9-97f2-2030edf9322a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:04.079095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-0201c616-0afe-43d9-97f2-2030edf9322a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:04.079095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:29:04.079095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:29:04.080015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201c616-0afe-43d9-97f2-2030edf9322a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:04.092434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 745/1500] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:04.096889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:04.098443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:04.134528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c988e8-4266-4769-a1c1-d9c911efc99e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:04.242579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d38adf-2567-43d6-9491-fddf986bbbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:04.243266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d38adf-2567-43d6-9491-fddf986bbbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:04.243544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d38adf-2567-43d6-9491-fddf986bbbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:04.243849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d38adf-2567-43d6-9491-fddf986bbbbb admin admin] PATH_INFO: `/v3/projects/7842715624054b5390394203291bfa6a/users/edc860ceb3434cfab43a7546d1174538/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:04.266345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d38adf-2567-43d6-9491-fddf986bbbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7842715624054b5390394203291bfa6a, user_id=edc860ceb3434cfab43a7546d1174538, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:04.267385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING py.warnings [None req-43d38adf-2567-43d6-9491-fddf986bbbbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:04.267385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: warnings.warn(msg) Jul 28 06:29:04.267385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: Jul 28 06:29:04.269390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d38adf-2567-43d6-9491-fddf986bbbbb admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:04.299411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 756/1501] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:04 2022] PUT /identity/v3/projects/7842715624054b5390394203291bfa6a/users/edc860ceb3434cfab43a7546d1174538/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:04.317754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63229-b9a6-4547-b5ea-d07ed169867d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:04.318261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63229-b9a6-4547-b5ea-d07ed169867d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:04.318664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63229-b9a6-4547-b5ea-d07ed169867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:04.380197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e7f63229-b9a6-4547-b5ea-d07ed169867d None None] MFA Rules not processed for user `edc860ceb3434cfab43a7546d1174538`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:04.381413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e7f63229-b9a6-4547-b5ea-d07ed169867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:04.460767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 746/1502] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:29:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:04.474533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe67-e899-4402-b38e-a0d5f8778c6a None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:04.474817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe67-e899-4402-b38e-a0d5f8778c6a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:04.475092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe67-e899-4402-b38e-a0d5f8778c6a None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:04.476552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 757/1503] 10.222.0.58 () {54 vars in 964 bytes} [Thu Jul 28 06:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:29:04.482594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155dd2-ad36-4252-8c60-aed03a769c3f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:04.482880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155dd2-ad36-4252-8c60-aed03a769c3f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:04.483154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155dd2-ad36-4252-8c60-aed03a769c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:04.514925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:04.562424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-8a155dd2-ad36-4252-8c60-aed03a769c3f None None] MFA Rules not processed for user `0c08bdb04cc146fa8f6c6bb626c30437`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:04.563654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8a155dd2-ad36-4252-8c60-aed03a769c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:04.640621 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 747/1504] 10.222.0.58 () {58 vars in 1061 bytes} [Thu Jul 28 06:29:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:04.648664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe67-e899-4402-b38e-a0d5f8778c6a None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:04.650201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6953fe67-e899-4402-b38e-a0d5f8778c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:04.706055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:04.776120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe67-e899-4402-b38e-a0d5f8778c6a None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:04.850070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:04.850693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:04.850971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:04.851248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:04.852888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:04.955855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:04.957307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:04.960849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:04.975642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 758/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:29:05.025383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3596f6-7bb9-4b38-a06a-f6c174392014 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:05.025897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3596f6-7bb9-4b38-a06a-f6c174392014 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:05.025897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3596f6-7bb9-4b38-a06a-f6c174392014 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:05.027223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 748/1506] 10.222.0.58 () {52 vars in 830 bytes} [Thu Jul 28 06:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:29:05.032012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:05.034003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:05.140030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782b47d-0033-4d5c-81d5-a4fa7eeba2a0 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:05.239960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:05.240622 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:05.240902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:05.241174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] PATH_INFO: `/v3/users/edc860ceb3434cfab43a7546d1174538` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:05.254706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc860ceb3434cfab43a7546d1174538)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:05.255784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING py.warnings [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:05.255784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: warnings.warn(msg) Jul 28 06:29:05.255784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: Jul 28 06:29:05.257005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:05.267027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:05.331314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc860ceb3434cfab43a7546d1174538'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:05.350286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc860ceb3434cfab43a7546d1174538'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:05.350745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc860ceb3434cfab43a7546d1174538'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:05.362364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc860ceb3434cfab43a7546d1174538'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:05.377237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc860ceb3434cfab43a7546d1174538'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:05.383845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 759/1507] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:05 2022] DELETE /identity/v3/users/edc860ceb3434cfab43a7546d1174538 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:05.389493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:05.389955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:05.390412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:05.452517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:05.453750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:05.540507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:05.555021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 749/1508] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:05.567730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:05.569002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:05.676044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b175e-6a41-434e-b200-9666c98e5b95 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:05.731982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:05.753592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57503085-9658-41b2-84b6-ac5ef34f845d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:05.754222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57503085-9658-41b2-84b6-ac5ef34f845d service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:05.754492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57503085-9658-41b2-84b6-ac5ef34f845d service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:05.754773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57503085-9658-41b2-84b6-ac5ef34f845d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:05.756466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-57503085-9658-41b2-84b6-ac5ef34f845d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:05.886120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57503085-9658-41b2-84b6-ac5ef34f845d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:05.887564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57503085-9658-41b2-84b6-ac5ef34f845d service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:05.907056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 760/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:29:06.270348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:06.271624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:06.283568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20880-709e-4743-84d1-9e0c57ed1386 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:06.381678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:06.382333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:06.382613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:06.382916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] PATH_INFO: `/v3/projects/7842715624054b5390394203291bfa6a` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:06.393300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7842715624054b5390394203291bfa6a)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:06.394358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:06.394358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:29:06.394358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:29:06.395600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:06.456163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7842715624054b5390394203291bfa6a', 'request_id': 'req-ad4480e1-b979-4b5c-8643-821ff97562f1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.469844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7842715624054b5390394203291bfa6a', 'request_id': 'req-ad4480e1-b979-4b5c-8643-821ff97562f1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.480758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7842715624054b5390394203291bfa6a', 'request_id': 'req-ad4480e1-b979-4b5c-8643-821ff97562f1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.504990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] The token cache is being invalidate because project 7842715624054b5390394203291bfa6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:06.505275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.505692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ad4480e1-b979-4b5c-8643-821ff97562f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.507107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 750/1510] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:06 2022] DELETE /identity/v3/projects/7842715624054b5390394203291bfa6a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:15.904457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=62 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:16.502819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:53.164015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc022-c61f-4a22-ae88-b3a21f2f2be4 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:53.164644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc022-c61f-4a22-ae88-b3a21f2f2be4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:53.164644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc022-c61f-4a22-ae88-b3a21f2f2be4 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:53.165933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:30:53.170929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e1c7-539e-479f-a48e-df00f265e8ff None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:53.171398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e1c7-539e-479f-a48e-df00f265e8ff None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:53.171493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e1c7-539e-479f-a48e-df00f265e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:53.260015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-8f95e1c7-539e-479f-a48e-df00f265e8ff None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:53.261286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8f95e1c7-539e-479f-a48e-df00f265e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:53.364871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:53.521466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dc022-c61f-4a22-ae88-b3a21f2f2be4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:53.525229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-484dc022-c61f-4a22-ae88-b3a21f2f2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:53.657198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dc022-c61f-4a22-ae88-b3a21f2f2be4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:53.664885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c38a-4aa9-4d6d-925d-737674c1998a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:53.665516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c38a-4aa9-4d6d-925d-737674c1998a service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:53.665802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c38a-4aa9-4d6d-925d-737674c1998a service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:53.666081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c38a-4aa9-4d6d-925d-737674c1998a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:53.678721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c38a-4aa9-4d6d-925d-737674c1998a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:53.681133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c38a-4aa9-4d6d-925d-737674c1998a service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:53.694889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 762/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:54.512693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cca96-b81b-4237-8454-e4b60eb127d8 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:54.513307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cca96-b81b-4237-8454-e4b60eb127d8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:54.513307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cca96-b81b-4237-8454-e4b60eb127d8 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:54.514586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:30:54.520009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c53cc6-e076-40ed-a398-10207532df74 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:54.520509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c53cc6-e076-40ed-a398-10207532df74 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:54.520614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c53cc6-e076-40ed-a398-10207532df74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:54.542998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-90c53cc6-e076-40ed-a398-10207532df74 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:54.544249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-90c53cc6-e076-40ed-a398-10207532df74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:54.554277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:54.714826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cca96-b81b-4237-8454-e4b60eb127d8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:54.739152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cca96-b81b-4237-8454-e4b60eb127d8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:54.746155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d55809-2a1e-4405-8cde-b323b637383f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:54.746765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55809-2a1e-4405-8cde-b323b637383f service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:54.747040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55809-2a1e-4405-8cde-b323b637383f service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:54.747308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55809-2a1e-4405-8cde-b323b637383f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:54.756329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d55809-2a1e-4405-8cde-b323b637383f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:54.757920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d55809-2a1e-4405-8cde-b323b637383f service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:54.768248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 753/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:54.982586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1a08-34f5-4eac-aa5f-bb427b7bc104 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:54.982889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1a08-34f5-4eac-aa5f-bb427b7bc104 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:54.983128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1a08-34f5-4eac-aa5f-bb427b7bc104 None None] PATH_INFO: `/v3` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:54.984499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 764/1517] 10.222.0.17 () {54 vars in 925 bytes} [Thu Jul 28 06:30:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:30:54.992599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335d71-cc8d-485f-8e74-ae50dafb8e40 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:54.992876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335d71-cc8d-485f-8e74-ae50dafb8e40 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:54.993185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335d71-cc8d-485f-8e74-ae50dafb8e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:55.063156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-dc335d71-cc8d-485f-8e74-ae50dafb8e40 None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:55.064431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dc335d71-cc8d-485f-8e74-ae50dafb8e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:55.082498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:55.139228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 754/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jul 28 06:30:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:04.537329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=56 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:05.009228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced0024-79c9-49f0-b5f7-35c3a330f9b4 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:05.009469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced0024-79c9-49f0-b5f7-35c3a330f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:05.009745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced0024-79c9-49f0-b5f7-35c3a330f9b4 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:05.011145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 765/1519] 10.222.0.58 () {54 vars in 961 bytes} [Thu Jul 28 06:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:31:05.016564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b44334-a17b-490f-9966-d7755358697f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:05.017155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b44334-a17b-490f-9966-d7755358697f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:05.017155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b44334-a17b-490f-9966-d7755358697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:05.039161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-15b44334-a17b-490f-9966-d7755358697f None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:05.040412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-15b44334-a17b-490f-9966-d7755358697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:05.049840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 755/1520] 10.222.0.58 () {58 vars in 1058 bytes} [Thu Jul 28 06:31:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:05.057792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced0024-79c9-49f0-b5f7-35c3a330f9b4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:05.072330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced0024-79c9-49f0-b5f7-35c3a330f9b4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:05.077537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276d9e-d3af-40e5-84c0-5a2be07712cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:05.078147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276d9e-d3af-40e5-84c0-5a2be07712cb service placement] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:05.078424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276d9e-d3af-40e5-84c0-5a2be07712cb service placement] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:05.078693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276d9e-d3af-40e5-84c0-5a2be07712cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:05.087188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04276d9e-d3af-40e5-84c0-5a2be07712cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:05.088782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04276d9e-d3af-40e5-84c0-5a2be07712cb service placement] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:05.098804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 766/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:31:05.998221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef319f2-4dd6-499b-a411-931ed21b5ad1 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:05.998723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef319f2-4dd6-499b-a411-931ed21b5ad1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:05.999144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef319f2-4dd6-499b-a411-931ed21b5ad1 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:06.001455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:31:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:31:06.006489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf64b8e-1b4f-4681-bb5b-7adcd512a6b3 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:06.006967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf64b8e-1b4f-4681-bb5b-7adcd512a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:06.007089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf64b8e-1b4f-4681-bb5b-7adcd512a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:06.028239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4cf64b8e-1b4f-4681-bb5b-7adcd512a6b3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:06.029412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4cf64b8e-1b4f-4681-bb5b-7adcd512a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:06.038132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:06.197884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef319f2-4dd6-499b-a411-931ed21b5ad1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:06.220935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef319f2-4dd6-499b-a411-931ed21b5ad1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:06.226959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e26ba-cb9f-4700-af69-139b2029d5f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:06.227582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e26ba-cb9f-4700-af69-139b2029d5f4 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:06.227903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e26ba-cb9f-4700-af69-139b2029d5f4 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:06.228177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e26ba-cb9f-4700-af69-139b2029d5f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:06.236547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e26ba-cb9f-4700-af69-139b2029d5f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:06.238146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e26ba-cb9f-4700-af69-139b2029d5f4 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:06.247908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 757/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:31:07.068169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec06d1a-a48c-4b8a-9736-e2bc0a9538f7 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:07.068685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec06d1a-a48c-4b8a-9736-e2bc0a9538f7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:07.068685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec06d1a-a48c-4b8a-9736-e2bc0a9538f7 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:07.070104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:31:07.076181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe69b4-af90-4c73-804a-f705dfb50e50 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:07.076564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe69b4-af90-4c73-804a-f705dfb50e50 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:07.076966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe69b4-af90-4c73-804a-f705dfb50e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:07.104552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5ffe69b4-af90-4c73-804a-f705dfb50e50 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:07.105768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5ffe69b4-af90-4c73-804a-f705dfb50e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:07.114057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:07.272537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec06d1a-a48c-4b8a-9736-e2bc0a9538f7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:07.296596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec06d1a-a48c-4b8a-9736-e2bc0a9538f7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:07.303695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c446b-8cbf-4038-b20e-922495bbdd87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:07.304326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c446b-8cbf-4038-b20e-922495bbdd87 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:07.304598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c446b-8cbf-4038-b20e-922495bbdd87 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:07.304866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c446b-8cbf-4038-b20e-922495bbdd87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:07.314163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c446b-8cbf-4038-b20e-922495bbdd87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:07.316142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c446b-8cbf-4038-b20e-922495bbdd87 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:07.326273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 769/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:31:11.215375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c98d-c863-4eb0-98c4-7b9a7f1f5b37 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:11.215942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c98d-c863-4eb0-98c4-7b9a7f1f5b37 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:11.215942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c98d-c863-4eb0-98c4-7b9a7f1f5b37 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:11.217461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:31:11.223017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60574-d43e-48eb-b27a-00c6018eac79 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:11.223461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60574-d43e-48eb-b27a-00c6018eac79 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:11.223579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60574-d43e-48eb-b27a-00c6018eac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:11.243432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2df60574-d43e-48eb-b27a-00c6018eac79 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:11.244638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2df60574-d43e-48eb-b27a-00c6018eac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:11.254021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:11.332346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697c98d-c863-4eb0-98c4-7b9a7f1f5b37 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:11.334272 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1697c98d-c863-4eb0-98c4-7b9a7f1f5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:11.422676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697c98d-c863-4eb0-98c4-7b9a7f1f5b37 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:11.427020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79f9e9-f11c-41ac-a234-54d8019797f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:11.427676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79f9e9-f11c-41ac-a234-54d8019797f6 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:11.427981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79f9e9-f11c-41ac-a234-54d8019797f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:11.428250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79f9e9-f11c-41ac-a234-54d8019797f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:11.438043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79f9e9-f11c-41ac-a234-54d8019797f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:11.439849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79f9e9-f11c-41ac-a234-54d8019797f6 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:11.449320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 760/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:31:13.407156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda97c-4ed4-4702-9e63-e6b36049cb43 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:13.408130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda97c-4ed4-4702-9e63-e6b36049cb43 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:13.413545 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda97c-4ed4-4702-9e63-e6b36049cb43 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:13.415710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:31:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:31:13.423803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf458f-b835-4b96-a422-f6bd43634e89 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:13.424383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf458f-b835-4b96-a422-f6bd43634e89 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:13.424383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf458f-b835-4b96-a422-f6bd43634e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:13.450906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-fbcf458f-b835-4b96-a422-f6bd43634e89 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:13.452722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-fbcf458f-b835-4b96-a422-f6bd43634e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:13.462777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:31:13.500201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda97c-4ed4-4702-9e63-e6b36049cb43 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:13.501979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9adda97c-4ed4-4702-9e63-e6b36049cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:13.516150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda97c-4ed4-4702-9e63-e6b36049cb43 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:13.520017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56607ebf-ff18-403a-aee4-ed53849d4587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:13.520635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56607ebf-ff18-403a-aee4-ed53849d4587 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:13.520916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56607ebf-ff18-403a-aee4-ed53849d4587 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:13.521228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56607ebf-ff18-403a-aee4-ed53849d4587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:13.530576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56607ebf-ff18-403a-aee4-ed53849d4587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:13.532043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56607ebf-ff18-403a-aee4-ed53849d4587 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:13.541442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 772/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:31:17.132706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c58a5-cbb5-417c-bfa3-ed328299313b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:17.133294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c58a5-cbb5-417c-bfa3-ed328299313b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:17.133294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c58a5-cbb5-417c-bfa3-ed328299313b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:17.134619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:31:17.141609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89e23-46e9-4853-8983-a92066cd86ad None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:17.142373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89e23-46e9-4853-8983-a92066cd86ad None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:17.142552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89e23-46e9-4853-8983-a92066cd86ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:17.175276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7be89e23-46e9-4853-8983-a92066cd86ad None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:17.176512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7be89e23-46e9-4853-8983-a92066cd86ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:17.186831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:17.500330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c58a5-cbb5-417c-bfa3-ed328299313b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:17.503542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-278c58a5-cbb5-417c-bfa3-ed328299313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:17.572732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:17.587102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c58a5-cbb5-417c-bfa3-ed328299313b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:17.591105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbd058-72af-4106-8bb4-4b0cf4636e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:17.591767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbd058-72af-4106-8bb4-4b0cf4636e09 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:17.592040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbd058-72af-4106-8bb4-4b0cf4636e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:17.592312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbd058-72af-4106-8bb4-4b0cf4636e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:17.602057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbd058-72af-4106-8bb4-4b0cf4636e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:17.603497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbd058-72af-4106-8bb4-4b0cf4636e09 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:17.613876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 763/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:31:19.678745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158aead-e9cf-4b31-82a8-63defc59580b None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:19.679590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158aead-e9cf-4b31-82a8-63defc59580b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:19.679590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158aead-e9cf-4b31-82a8-63defc59580b None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:19.682381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:31:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:31:19.689940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1161913-65b2-4f4b-bcb3-082df99e1e80 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:19.690701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1161913-65b2-4f4b-bcb3-082df99e1e80 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:19.690881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1161913-65b2-4f4b-bcb3-082df99e1e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:19.711276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f1161913-65b2-4f4b-bcb3-082df99e1e80 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:19.712506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f1161913-65b2-4f4b-bcb3-082df99e1e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:19.721771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:20.027737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158aead-e9cf-4b31-82a8-63defc59580b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:20.029831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f158aead-e9cf-4b31-82a8-63defc59580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:20.049037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158aead-e9cf-4b31-82a8-63defc59580b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:20.053902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89e3a6-facc-4193-8dcc-c6833898396f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:20.054531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e3a6-facc-4193-8dcc-c6833898396f service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:20.054790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e3a6-facc-4193-8dcc-c6833898396f service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:20.055060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e3a6-facc-4193-8dcc-c6833898396f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:20.065030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89e3a6-facc-4193-8dcc-c6833898396f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:20.066451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89e3a6-facc-4193-8dcc-c6833898396f service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:20.078183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 775/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:31:29.706540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=11 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:30.072455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=33 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:51.460186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1e0d-9ebe-4b4c-abb3-847b203fa58f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.462732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1e0d-9ebe-4b4c-abb3-847b203fa58f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.462732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1e0d-9ebe-4b4c-abb3-847b203fa58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.489611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-804e1e0d-9ebe-4b4c-abb3-847b203fa58f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.491206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-804e1e0d-9ebe-4b4c-abb3-847b203fa58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.501903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 765/1540] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.514061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49b2a-94ed-490f-b8e2-3d2826b2aaa4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.514658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49b2a-94ed-490f-b8e2-3d2826b2aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.514658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49b2a-94ed-490f-b8e2-3d2826b2aaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.549529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a5f49b2a-94ed-490f-b8e2-3d2826b2aaa4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.550748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a5f49b2a-94ed-490f-b8e2-3d2826b2aaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.561777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 776/1541] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.567198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1e0d-9ebe-4b4c-abb3-847b203fa58f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:51.581783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1e0d-9ebe-4b4c-abb3-847b203fa58f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:51.589142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c089c-e0cc-4839-87f6-fa0783850959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:51.590036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c089c-e0cc-4839-87f6-fa0783850959 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.590539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c089c-e0cc-4839-87f6-fa0783850959 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.591024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c089c-e0cc-4839-87f6-fa0783850959 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.591989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c089c-e0cc-4839-87f6-fa0783850959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:51.592510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c089c-e0cc-4839-87f6-fa0783850959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:51.594339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c089c-e0cc-4839-87f6-fa0783850959 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:51.613058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 766/1542] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:51.622705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f49b2a-94ed-490f-b8e2-3d2826b2aaa4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:51.634635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f49b2a-94ed-490f-b8e2-3d2826b2aaa4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:51.643585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9703d40-897e-4c48-9869-caf56947011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:51.644255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9703d40-897e-4c48-9869-caf56947011b admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.644539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9703d40-897e-4c48-9869-caf56947011b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.644818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9703d40-897e-4c48-9869-caf56947011b admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.645500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9703d40-897e-4c48-9869-caf56947011b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:51.647421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9703d40-897e-4c48-9869-caf56947011b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:51.664188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c87bca-4826-4b45-b435-060f0a3ead8a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.664855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c87bca-4826-4b45-b435-060f0a3ead8a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.665402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c87bca-4826-4b45-b435-060f0a3ead8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.705681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e4c87bca-4826-4b45-b435-060f0a3ead8a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.707423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e4c87bca-4826-4b45-b435-060f0a3ead8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.716250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 777/1543] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:51.717563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71ecb8-3c45-4a6d-bfe8-21bf90d68530 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.717859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71ecb8-3c45-4a6d-bfe8-21bf90d68530 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.718133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71ecb8-3c45-4a6d-bfe8-21bf90d68530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.722294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 767/1544] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.726817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c87bca-4826-4b45-b435-060f0a3ead8a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:51.743101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c87bca-4826-4b45-b435-060f0a3ead8a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:51.758729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1d71ecb8-3c45-4a6d-bfe8-21bf90d68530 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.759970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1d71ecb8-3c45-4a6d-bfe8-21bf90d68530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.822906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc608e-5110-4c9c-9d8a-2330fe8cf790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:51.823562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc608e-5110-4c9c-9d8a-2330fe8cf790 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.823883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc608e-5110-4c9c-9d8a-2330fe8cf790 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.824156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc608e-5110-4c9c-9d8a-2330fe8cf790 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.824882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc608e-5110-4c9c-9d8a-2330fe8cf790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:51.826895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc608e-5110-4c9c-9d8a-2330fe8cf790 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:51.855379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 778/1545] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.856057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 768/1546] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:51.857248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6ecc-2ed7-49c4-b8eb-8ebc68e2c5dc None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.857446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f89e3-ee4d-442c-a8c4-bf0476c360c7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.857576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6ecc-2ed7-49c4-b8eb-8ebc68e2c5dc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.857870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f89e3-ee4d-442c-a8c4-bf0476c360c7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.858150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f89e3-ee4d-442c-a8c4-bf0476c360c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.858880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6ecc-2ed7-49c4-b8eb-8ebc68e2c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.879010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-287f89e3-ee4d-442c-a8c4-bf0476c360c7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.879255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1e8e6ecc-2ed7-49c4-b8eb-8ebc68e2c5dc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.880234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-287f89e3-ee4d-442c-a8c4-bf0476c360c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.880366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1e8e6ecc-2ed7-49c4-b8eb-8ebc68e2c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.893146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 779/1548] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.893373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 769/1548] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.893486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852bfa1-3614-437d-9a13-ecea29425f69 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.893574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02354105-5842-4e2b-bc77-c9d2927b88d7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.893657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852bfa1-3614-437d-9a13-ecea29425f69 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.893742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02354105-5842-4e2b-bc77-c9d2927b88d7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.893817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852bfa1-3614-437d-9a13-ecea29425f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.893923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02354105-5842-4e2b-bc77-c9d2927b88d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.915481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-02354105-5842-4e2b-bc77-c9d2927b88d7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.916215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a852bfa1-3614-437d-9a13-ecea29425f69 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.916820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-02354105-5842-4e2b-bc77-c9d2927b88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.917545 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a852bfa1-3614-437d-9a13-ecea29425f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.924638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 770/1549] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.925383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 780/1550] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.926177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852bfa1-3614-437d-9a13-ecea29425f69 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:51.927650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d68ad-ff61-4195-a080-9b636b5a06f7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.927904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d68ad-ff61-4195-a080-9b636b5a06f7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.931122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d68ad-ff61-4195-a080-9b636b5a06f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.936746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852bfa1-3614-437d-9a13-ecea29425f69 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:51.941636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d47e43-7209-41e4-8836-b3ee10187aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:51.942255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47e43-7209-41e4-8836-b3ee10187aff admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.942533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47e43-7209-41e4-8836-b3ee10187aff admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.943220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47e43-7209-41e4-8836-b3ee10187aff admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.943494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d47e43-7209-41e4-8836-b3ee10187aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:51.945124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d47e43-7209-41e4-8836-b3ee10187aff admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:51.949002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f42d68ad-ff61-4195-a080-9b636b5a06f7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.950209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f42d68ad-ff61-4195-a080-9b636b5a06f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.955436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 781/1551] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:51.956520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a08c16-1576-409a-b4c2-a83167003743 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.956807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a08c16-1576-409a-b4c2-a83167003743 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.957080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a08c16-1576-409a-b4c2-a83167003743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.959825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 771/1552] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:51.960504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d68ad-ff61-4195-a080-9b636b5a06f7 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:51.970598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d68ad-ff61-4195-a080-9b636b5a06f7 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:51.975152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695685ba-08ec-4070-a27c-19c970ac34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:51.975766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695685ba-08ec-4070-a27c-19c970ac34a4 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.976046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695685ba-08ec-4070-a27c-19c970ac34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.976319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695685ba-08ec-4070-a27c-19c970ac34a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:51.977036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695685ba-08ec-4070-a27c-19c970ac34a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:51.977337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695685ba-08ec-4070-a27c-19c970ac34a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:51.978944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695685ba-08ec-4070-a27c-19c970ac34a4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:51.980764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-b3a08c16-1576-409a-b4c2-a83167003743 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:51.981955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b3a08c16-1576-409a-b4c2-a83167003743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:51.992901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 772/1553] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:51.994328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06637-2be8-49d2-be7d-b5af9f122d90 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:51.994640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06637-2be8-49d2-be7d-b5af9f122d90 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:51.995052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06637-2be8-49d2-be7d-b5af9f122d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.002915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 782/1554] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.004666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbee1-b0db-4695-b8d0-848f3ae3d887 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.005017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbee1-b0db-4695-b8d0-848f3ae3d887 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.005362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbee1-b0db-4695-b8d0-848f3ae3d887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.015966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-00e06637-2be8-49d2-be7d-b5af9f122d90 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:52.017414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-00e06637-2be8-49d2-be7d-b5af9f122d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:52.026962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ac8dbee1-b0db-4695-b8d0-848f3ae3d887 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:52.028378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ac8dbee1-b0db-4695-b8d0-848f3ae3d887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:52.033167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 773/1555] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.034447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829a4c-f360-45ee-a6db-ac2614fe7780 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.034732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829a4c-f360-45ee-a6db-ac2614fe7780 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.035011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829a4c-f360-45ee-a6db-ac2614fe7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.040572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 783/1556] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.040572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee590dbe-665c-4a4a-b1cf-4d723ff925af None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.040572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee590dbe-665c-4a4a-b1cf-4d723ff925af None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.040572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee590dbe-665c-4a4a-b1cf-4d723ff925af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.059114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-77829a4c-f360-45ee-a6db-ac2614fe7780 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:52.060410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-77829a4c-f360-45ee-a6db-ac2614fe7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:52.065561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ee590dbe-665c-4a4a-b1cf-4d723ff925af None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:52.066993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ee590dbe-665c-4a4a-b1cf-4d723ff925af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:52.069163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 774/1557] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.072982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829a4c-f360-45ee-a6db-ac2614fe7780 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.079516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 784/1558] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.079700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829a4c-f360-45ee-a6db-ac2614fe7780 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.081468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134c60-08d8-4906-b55e-2b8a016200ae None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.081847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134c60-08d8-4906-b55e-2b8a016200ae None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.082315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134c60-08d8-4906-b55e-2b8a016200ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.084364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.084973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.085250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.085525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.086336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.088130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.101869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 775/1559] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:52.101869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.107253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ea134c60-08d8-4906-b55e-2b8a016200ae None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:52.108772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ea134c60-08d8-4906-b55e-2b8a016200ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:52.110095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e2e8-fbff-46e6-a13e-770858017c86 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.114729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025216b9-32e1-42dd-9ec7-45c215e4346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.115340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025216b9-32e1-42dd-9ec7-45c215e4346a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.115633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025216b9-32e1-42dd-9ec7-45c215e4346a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.115913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025216b9-32e1-42dd-9ec7-45c215e4346a admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.116682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025216b9-32e1-42dd-9ec7-45c215e4346a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.117701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-025216b9-32e1-42dd-9ec7-45c215e4346a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:32:52.117701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:32:52.117701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:32:52.118282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 785/1560] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.119447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea134c60-08d8-4906-b55e-2b8a016200ae None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.122931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025216b9-32e1-42dd-9ec7-45c215e4346a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.129649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea134c60-08d8-4906-b55e-2b8a016200ae None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.134409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.135118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.135475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.135843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.136788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:52.137100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.138177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING py.warnings [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:32:52.138177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: warnings.warn(msg) Jul 28 06:32:52.138177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: Jul 28 06:32:52.139206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.159780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 786/1561] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:52.159780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.160125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 776/1562] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.160125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933311d8-2f67-49f6-b4ef-beb264c25078 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.160125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933311d8-2f67-49f6-b4ef-beb264c25078 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.160125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933311d8-2f67-49f6-b4ef-beb264c25078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.166441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c9ff2-848b-46a6-a993-9f62165192ca admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.177666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-933311d8-2f67-49f6-b4ef-beb264c25078 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:52.178976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-933311d8-2f67-49f6-b4ef-beb264c25078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:52.222455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:52.236493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.237137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.237463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.237699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.238400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:52.238708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.241026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.242571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:52.244883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 777/1563] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.245863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933311d8-2f67-49f6-b4ef-beb264c25078 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.257283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 787/1564] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:52.258580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.270102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933311d8-2f67-49f6-b4ef-beb264c25078 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.270323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750af6-e02e-486f-a3b6-a237d1820896 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.274878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.275483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.275609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.275823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.276160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.276449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.276801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.276902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:52.277138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.277241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.277899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:52.278267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.278728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.280032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.291178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 788/1565] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:52.292251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 778/1566] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:52.292852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.293088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.304390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b283-68ad-41ca-b2da-e416c02951d6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.304667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecd470-0443-45f7-ab4c-711fbd4e3a3f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.310021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.310634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.310832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.311081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.311254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.311363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] PATH_INFO: `/v3/projects/ac6039b5403a4f44966868ddf7715f8e/users/270693550b1e4d4888290abe6030b108/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.311525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.311802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.312872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:52.313814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.316618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.326818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6039b5403a4f44966868ddf7715f8e, user_id=270693550b1e4d4888290abe6030b108, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.329598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.331837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 779/1567] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:52.332844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.344836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80516a-9997-450c-9adc-97163d683788 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.349851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.350466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.350742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.351015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.351813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.352585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 789/1568] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:52 2022] PUT /identity/v3/projects/ac6039b5403a4f44966868ddf7715f8e/users/270693550b1e4d4888290abe6030b108/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:52.353411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.353825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.376834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 780/1569] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.377956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.387549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ce04f-ba73-4ba2-94fb-9bf255c95f8a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.416201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36525a-4792-40cb-8b85-7c31a3fe9b6f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.421206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.421837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.422110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.422479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.423148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.425350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.442324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.442989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.443275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.443503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.444287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:32:52.444576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.446191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.453526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 790/1570] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.454175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.468890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 781/1571] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:32:52.468890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.479405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e832-f4a4-45a8-ad74-12b655f7411b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.515212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ea15c-29b8-4e74-b530-5da52f89556e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.519912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.520539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.520823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.521102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.521802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.523863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.535791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.536422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.536705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.536984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.537641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.539556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.551053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 791/1572] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.551888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.571676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 782/1573] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.572609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.583639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:52.594374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:52.616987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8ce0-3805-4698-8f55-6394c0a7cd7f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.636764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872044-a861-4a9b-a530-446650959cd6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.641535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975625f6-67be-43a4-89d4-09f6260012aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.642154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975625f6-67be-43a4-89d4-09f6260012aa admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.642430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975625f6-67be-43a4-89d4-09f6260012aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.642701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975625f6-67be-43a4-89d4-09f6260012aa admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.643354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975625f6-67be-43a4-89d4-09f6260012aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.645343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975625f6-67be-43a4-89d4-09f6260012aa admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.674733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 783/1574] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.675478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.676018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694c2d4-11f5-44d4-96be-c973de1bdbeb None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.676147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.676296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694c2d4-11f5-44d4-96be-c973de1bdbeb None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.676411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.676565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694c2d4-11f5-44d4-96be-c973de1bdbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.676676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.677291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.679442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.695441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1694c2d4-11f5-44d4-96be-c973de1bdbeb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:52.696749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1694c2d4-11f5-44d4-96be-c973de1bdbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:52.712795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 792/1575] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.712795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.766676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 784/1576] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:52.766676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694c2d4-11f5-44d4-96be-c973de1bdbeb None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.773476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694c2d4-11f5-44d4-96be-c973de1bdbeb None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.778406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.779007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.779134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19304-33f7-4d69-9f66-9a9741e98ae9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.779302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.779581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.780264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.782208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.783653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.784269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.784599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.784814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.785496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.787223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.798346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 793/1577] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:52.800650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.810136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 785/1578] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.810457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4313fe-37f8-448d-b152-e79167823853 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.811005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.817802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.818438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.818726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.819000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.819696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.821155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254c46-82f0-4175-b3e7-d18dab38002a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.821651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.825782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.826393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.826672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.826950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.827609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.829553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.852061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 794/1579] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.852645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 786/1580] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.853128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.853764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.863780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1fb7-5ecb-4182-86d1-9dd47c450c6b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.889590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:52.919024 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a323962-594d-42c8-ab5d-88998221c9df admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.920043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.920633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.921567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.921846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.922513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.923698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.924348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.924538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.924652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.924894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.925558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.926650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING py.warnings [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:32:52.926650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: warnings.warn(msg) Jul 28 06:32:52.926650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: Jul 28 06:32:52.927881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.943817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:52.949502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 787/1581] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.950320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.952007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 795/1582] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.953280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:52.964424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e815db-adb7-45dd-be75-59727b7aac23 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:52.969143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:52.969756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:52.970040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:52.970315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:52.970974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:52.972935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:52.998788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 788/1583] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:52 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:52.999609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.011578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad1923-d9e5-47f2-b530-5cfe2d74ada7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.013779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a8ee3-f590-41b2-a469-e0ffb17d9ea8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.016787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.017362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.017534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.017784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.018166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.018275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.018447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.018765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.019038 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.020693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.030075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.031712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.036867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 789/1584] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.037597 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.046408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 796/1585] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:53.047321 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.048650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2d393-e271-416a-90a8-4f16306d8d4d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.053522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.054151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.054428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.054705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.055392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.057245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.058127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d744-fe87-43ae-b177-bb75a23614d1 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.064514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.065364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.065840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.066314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.067185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.068174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 790/1586] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.069068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.069555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.080501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae1da-f820-4e4d-9501-cf1f2b7773bb admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.085417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.086065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.086347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.086614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.087370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.089299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.091367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 797/1587] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.092455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.104188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ccb34-2be7-474f-ac7e-f34c5f776dde admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.109509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.111681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.111947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.112245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.112952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.114566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.123255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 791/1588] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:53 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:53.124495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.126077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 798/1589] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.126859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.137139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b177d9-54f7-435a-ab69-490e91971c20 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.140078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146ac6-dd8e-4a30-82a2-8161cc77851a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.142352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.143141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.143611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.143891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.144612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.146275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.146419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.147001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.147352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.147738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.148446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.150051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.158335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 799/1590] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.159448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.166645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 792/1591] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.167486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.170311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798ed63-7435-4448-813c-4e3d785671e3 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.175502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.176378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.176828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.177274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] PATH_INFO: `/v3/projects/3b079157c1414b53b49b8b9410b7bf35/users/7c7a79e850e04b918862c6dfcf2ea999/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.180601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f84f-a54a-49d8-9763-bb190d38bca9 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.185856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.186472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.186748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.187026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.187757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.189725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.195248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b079157c1414b53b49b8b9410b7bf35, user_id=7c7a79e850e04b918862c6dfcf2ea999, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.198115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.201034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 793/1592] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.202162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.214429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699b74b-749c-4de0-93bf-8849ac4b6a36 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.219755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 800/1593] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:53 2022] PUT /identity/v3/projects/3b079157c1414b53b49b8b9410b7bf35/users/7c7a79e850e04b918862c6dfcf2ea999/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:53.220599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.296004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.296954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.297398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.297681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.298400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.300051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.304756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5918-685c-45fb-886f-15b81cccac51 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.310159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.310791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.311068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.311335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.312060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.313904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 794/1594] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.314098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.314744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.326307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 801/1595] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.327555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.328134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4d506-696b-4043-97af-0b08c365bfb8 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.334518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:53.338148 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.338789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.339069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.339337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.339513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b100afa-cbdc-4832-8728-a3f1efd89936 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.340159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.341972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.346154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.347088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.347851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.348116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.348958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.350618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.356264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 795/1596] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.356264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.369905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 802/1597] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.370101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972c01-a6db-4e1d-8bec-d098a84e623f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.370231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.375900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea91a1-41ef-4a78-a7c8-1492d23a316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.376578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea91a1-41ef-4a78-a7c8-1492d23a316f admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.376951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea91a1-41ef-4a78-a7c8-1492d23a316f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.377297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea91a1-41ef-4a78-a7c8-1492d23a316f admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.378519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea91a1-41ef-4a78-a7c8-1492d23a316f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.379279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4cd0c-4193-441f-bde7-d1f028702d51 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.380894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea91a1-41ef-4a78-a7c8-1492d23a316f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.387708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.388674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.388953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.389385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] PATH_INFO: `/v3/projects/09851b8f35a1425c9290a0b3110874fc/users/bcdd12eeacba4ab18294b7822b4a0a0c/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.394069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 796/1598] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.394856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed1ba-3d93-42f9-9499-5d19b0bced3f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.395226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed1ba-3d93-42f9-9499-5d19b0bced3f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.395506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed1ba-3d93-42f9-9499-5d19b0bced3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.416228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09851b8f35a1425c9290a0b3110874fc, user_id=bcdd12eeacba4ab18294b7822b4a0a0c, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.419480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.437556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 803/1599] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:53 2022] PUT /identity/v3/projects/09851b8f35a1425c9290a0b3110874fc/users/bcdd12eeacba4ab18294b7822b4a0a0c/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:53.439215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.454077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7e7ed1ba-3d93-42f9-9499-5d19b0bced3f None None] MFA Rules not processed for user `7c7a79e850e04b918862c6dfcf2ea999`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:53.455499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7e7ed1ba-3d93-42f9-9499-5d19b0bced3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:53.503399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:53.529881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 797/1600] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:53.530766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed1ba-3d93-42f9-9499-5d19b0bced3f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.533640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94cf24-0085-43e5-bbf0-80b55b9ff2c8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.543060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.543546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed1ba-3d93-42f9-9499-5d19b0bced3f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.544500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.545047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.545504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] PATH_INFO: `/v3/projects/65f9c54a34c2404dbb973620e3fd8b48/users/d6adc20fc5b74905ad503a3fc9a47f25/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.548149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.548712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.548990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.549262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.549952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.551549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.561951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 798/1601] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:53.562839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.566858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f9c54a34c2404dbb973620e3fd8b48, user_id=d6adc20fc5b74905ad503a3fc9a47f25, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.570700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.573845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091c27d-6995-4d5a-810d-cfb4aa87a7f0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.579666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.580363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.580637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.580912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] PATH_INFO: `/v3/projects/9fbcf1645e82413abc80bc89892f8891/users/ec303a823f554fae8e5faf6f1e3df154/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.586556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 804/1602] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:53 2022] PUT /identity/v3/projects/65f9c54a34c2404dbb973620e3fd8b48/users/d6adc20fc5b74905ad503a3fc9a47f25/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:53.587761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.605149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbcf1645e82413abc80bc89892f8891, user_id=ec303a823f554fae8e5faf6f1e3df154, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.606330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:32:53.606330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:32:53.606330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:32:53.608555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.624716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 799/1603] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:53 2022] PUT /identity/v3/projects/9fbcf1645e82413abc80bc89892f8891/users/ec303a823f554fae8e5faf6f1e3df154/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:53.625762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.665888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23498b-5e6b-4efd-b082-1eea043a7796 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.701925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6dd80-dcc9-4565-be7f-561c81af9677 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.711252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40a388-e954-426c-a3f0-32ff0f920d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.712081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40a388-e954-426c-a3f0-32ff0f920d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.712336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40a388-e954-426c-a3f0-32ff0f920d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.712593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40a388-e954-426c-a3f0-32ff0f920d00 admin admin] PATH_INFO: `/v3/projects/caf08919aebf44bfbd92cc49c31ac019/users/900c6f2526c3496e9bc0d1a936bafb94/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.731368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40a388-e954-426c-a3f0-32ff0f920d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf08919aebf44bfbd92cc49c31ac019, user_id=900c6f2526c3496e9bc0d1a936bafb94, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.732444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.733154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.733437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.733719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] PATH_INFO: `/v3/projects/1cbcbb427b0d4b47903f586f02e40a64/users/f25041ca39b84b0b9a3b742d0e43e7e0/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.735829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40a388-e954-426c-a3f0-32ff0f920d00 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.736387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:53.754197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbcbb427b0d4b47903f586f02e40a64, user_id=f25041ca39b84b0b9a3b742d0e43e7e0, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.757006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.768498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 800/1604] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:53 2022] PUT /identity/v3/projects/caf08919aebf44bfbd92cc49c31ac019/users/900c6f2526c3496e9bc0d1a936bafb94/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:53.773751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8af583-2263-4416-99f6-e00142912e67 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.774035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8af583-2263-4416-99f6-e00142912e67 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.774313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8af583-2263-4416-99f6-e00142912e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.784791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 805/1605] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:53 2022] PUT /identity/v3/projects/1cbcbb427b0d4b47903f586f02e40a64/users/f25041ca39b84b0b9a3b742d0e43e7e0/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:53.787138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.820405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1b8af583-2263-4416-99f6-e00142912e67 None None] MFA Rules not processed for user `bcdd12eeacba4ab18294b7822b4a0a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:53.821628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1b8af583-2263-4416-99f6-e00142912e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:53.881327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b97ac4-bae2-44ea-b01b-1d76fe5363d4 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.886164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3c287-cc70-4f6f-9506-d07fcd5ff1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.886812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c287-cc70-4f6f-9506-d07fcd5ff1ba admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.887259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c287-cc70-4f6f-9506-d07fcd5ff1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.887505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c287-cc70-4f6f-9506-d07fcd5ff1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.888226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3c287-cc70-4f6f-9506-d07fcd5ff1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.890234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3c287-cc70-4f6f-9506-d07fcd5ff1ba admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.899242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 801/1606] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:53.900814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8af583-2263-4416-99f6-e00142912e67 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:53.915280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8af583-2263-4416-99f6-e00142912e67 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:53.924168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103a6e6-1152-4ea5-9881-80430a630a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:53.924807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a6e6-1152-4ea5-9881-80430a630a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.925598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a6e6-1152-4ea5-9881-80430a630a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.925896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a6e6-1152-4ea5-9881-80430a630a22 admin admin] PATH_INFO: `/v3/projects/35cdaa57d74941b4b0afef726661b813/users/63fe53c8b34a4ff19e8712c3bed6b274/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.936408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 806/1607] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:53 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:53.936408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aee607-8edc-4be9-8f77-5ac7a5da01e9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.936408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aee607-8edc-4be9-8f77-5ac7a5da01e9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.936408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aee607-8edc-4be9-8f77-5ac7a5da01e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:53.957368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103a6e6-1152-4ea5-9881-80430a630a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cdaa57d74941b4b0afef726661b813, user_id=63fe53c8b34a4ff19e8712c3bed6b274, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:53.960742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103a6e6-1152-4ea5-9881-80430a630a22 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:53.972358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-74aee607-8edc-4be9-8f77-5ac7a5da01e9 None None] MFA Rules not processed for user `d6adc20fc5b74905ad503a3fc9a47f25`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:53.974217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:53.974357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-74aee607-8edc-4be9-8f77-5ac7a5da01e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:53.983365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 802/1608] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:53 2022] PUT /identity/v3/projects/35cdaa57d74941b4b0afef726661b813/users/63fe53c8b34a4ff19e8712c3bed6b274/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:53.985080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db265-d2e0-4d01-9a25-9be73665a305 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:53.985609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db265-d2e0-4d01-9a25-9be73665a305 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:53.986258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db265-d2e0-4d01-9a25-9be73665a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.007601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4e0db265-d2e0-4d01-9a25-9be73665a305 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:54.009396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4e0db265-d2e0-4d01-9a25-9be73665a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:54.068556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 807/1609] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:54.069786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432c24-5bef-430e-8b8f-81850dfc1694 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.070077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432c24-5bef-430e-8b8f-81850dfc1694 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.070402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432c24-5bef-430e-8b8f-81850dfc1694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.091457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 803/1610] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:54.092227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e6432c24-5bef-430e-8b8f-81850dfc1694 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:54.093396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130708-3616-4ae0-a013-f5ffe64868d1 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.093798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e6432c24-5bef-430e-8b8f-81850dfc1694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:54.094095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130708-3616-4ae0-a013-f5ffe64868d1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.094555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130708-3616-4ae0-a013-f5ffe64868d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.112037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 808/1611] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:54.113884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9034-8c4a-4ca9-bd72-aeae1451077e None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.114274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9034-8c4a-4ca9-bd72-aeae1451077e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.114648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9034-8c4a-4ca9-bd72-aeae1451077e None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.116855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-50130708-3616-4ae0-a013-f5ffe64868d1 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:54.118299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-50130708-3616-4ae0-a013-f5ffe64868d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:54.127532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 804/1612] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:54.128714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130708-3616-4ae0-a013-f5ffe64868d1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.138809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 809/1613] 10.222.0.58 () {54 vars in 962 bytes} [Thu Jul 28 06:32:54 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:32:54.140332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130708-3616-4ae0-a013-f5ffe64868d1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.140468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f800e6-6cbc-4ca0-ac46-10b27cb85f7c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.141056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f800e6-6cbc-4ca0-ac46-10b27cb85f7c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.141410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f800e6-6cbc-4ca0-ac46-10b27cb85f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.146350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.147278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.147774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.148249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.149145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.151471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.165422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-39f800e6-6cbc-4ca0-ac46-10b27cb85f7c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:54.167748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-39f800e6-6cbc-4ca0-ac46-10b27cb85f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:54.179427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 810/1614] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:54.179427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f800e6-6cbc-4ca0-ac46-10b27cb85f7c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.185114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 805/1615] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:54 2022] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:54.185872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.199051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f800e6-6cbc-4ca0-ac46-10b27cb85f7c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.203927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.204729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.205011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.205295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.206277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.208120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.244588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 811/1616] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:54.245568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.255931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fad94-9833-40e1-a22f-bc9bf942a5fd admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.284822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:54.324013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece718b3-cde0-4c7b-b593-a6c1be23e1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.327325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece718b3-cde0-4c7b-b593-a6c1be23e1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.327447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4e3ee-0fd3-455f-aaa2-1a2efbd00e15 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.327533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece718b3-cde0-4c7b-b593-a6c1be23e1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.327533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece718b3-cde0-4c7b-b593-a6c1be23e1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.331264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.331929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.332212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.332499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.404633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:54.426458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece718b3-cde0-4c7b-b593-a6c1be23e1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.428306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece718b3-cde0-4c7b-b593-a6c1be23e1b9 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.430393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.432623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.441718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 806/1617] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:54.443187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa197-208d-4b29-94ab-9967ff1cb63e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.443476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa197-208d-4b29-94ab-9967ff1cb63e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.443791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa197-208d-4b29-94ab-9967ff1cb63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.446656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 812/1618] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:54.447510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.460353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099446-490e-4c36-b559-34938fbcda1a service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.464591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.465328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.466400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.466400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.477495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.480594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.494208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 813/1619] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:54.495762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.504689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-87daa197-208d-4b29-94ab-9967ff1cb63e None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:54.505794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-87daa197-208d-4b29-94ab-9967ff1cb63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:54.507977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92533-8217-4433-838c-6781f0d3c285 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.513638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.514540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.514875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.515229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.516075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.517960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.533244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 814/1620] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:54.533244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.545221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bf044-6565-4af0-be29-28c7a3af8aa2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.549744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.550731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.551012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.551324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.566412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.568230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.580243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 815/1621] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:54.581385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.599097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202335-44ba-4b1d-8309-6c6992616a36 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.611489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.612184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.612471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.612769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.614617 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.616743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.633171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 807/1622] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Jul 28 06:32:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:54.634183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daa197-208d-4b29-94ab-9967ff1cb63e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.646064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daa197-208d-4b29-94ab-9967ff1cb63e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.651825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.652587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.652872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.653153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] PATH_INFO: `/v3/projects/c4e2fd8c0cf5454abdc63087bd647a25/users/058a8bd6cd204dce920e6853f382fdb6/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.675697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e2fd8c0cf5454abdc63087bd647a25, user_id=058a8bd6cd204dce920e6853f382fdb6, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.678633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.682154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 816/1623] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:54 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:54.685042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.718226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 808/1624] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:54 2022] PUT /identity/v3/projects/c4e2fd8c0cf5454abdc63087bd647a25/users/058a8bd6cd204dce920e6853f382fdb6/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:54.719183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.724149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce74a-6b5c-4028-ac3b-7e3efc1c226c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.829355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a8a9-7209-4bef-8702-9ba1f4703a3a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.840487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.841732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.842137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.842484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.843547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.846048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.854476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.855200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.855542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.856002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.872672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:54.873587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 809/1625] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:54.874838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.895778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c183-67d3-4d47-9469-4526441a5b04 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.901661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.902372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.902695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.903306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.905724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.907922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.926194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 810/1626] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:54.926194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.931365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.933595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.940194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384b258-a03d-459a-a7a6-b5ae3d06c0a0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.945482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 817/1627] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:54.946241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:54.946359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.947049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.947386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.947860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] PATH_INFO: `/v3/projects/815730176fea49899b50491207b43684/users/4d5e2e678f324d40b6f7a99f05a8e54c/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.967850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e773e-fa39-4b7f-b342-77f52dd04996 service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:54.972234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] RBAC: Authorizing `identity:create_grant(project_id=815730176fea49899b50491207b43684, user_id=4d5e2e678f324d40b6f7a99f05a8e54c, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.975047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84092f12-1360-4c60-a98f-f1aa9a252fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:54.976026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092f12-1360-4c60-a98f-f1aa9a252fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:54.976482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092f12-1360-4c60-a98f-f1aa9a252fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:54.977290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092f12-1360-4c60-a98f-f1aa9a252fd3 admin admin] PATH_INFO: `/v3/projects/c4e2fd8c0cf5454abdc63087bd647a25/users/058a8bd6cd204dce920e6853f382fdb6/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:54.979801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092f12-1360-4c60-a98f-f1aa9a252fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e2fd8c0cf5454abdc63087bd647a25, user_id=058a8bd6cd204dce920e6853f382fdb6, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:54.980152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.983524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092f12-1360-4c60-a98f-f1aa9a252fd3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:54.989601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:55.000504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 818/1628] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:54 2022] PUT /identity/v3/projects/c4e2fd8c0cf5454abdc63087bd647a25/users/058a8bd6cd204dce920e6853f382fdb6/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:55.015033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5e0d-86a7-467f-bad7-0553e8a7249c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.015684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5e0d-86a7-467f-bad7-0553e8a7249c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.017723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5e0d-86a7-467f-bad7-0553e8a7249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.067425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 811/1629] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:54 2022] PUT /identity/v3/projects/815730176fea49899b50491207b43684/users/4d5e2e678f324d40b6f7a99f05a8e54c/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:55.067425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:55.108442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a33e5e0d-86a7-467f-bad7-0553e8a7249c None None] MFA Rules not processed for user `058a8bd6cd204dce920e6853f382fdb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:55.110718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a33e5e0d-86a7-467f-bad7-0553e8a7249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:55.198505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18b80c-8eed-4939-8057-d67cb26a799b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:55.204564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:55.205299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.205585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.205906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.206618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:55.208600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:55.228189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 812/1630] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:55.232601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 819/1631] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:55.232710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:55.243001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e5e0d-86a7-467f-bad7-0553e8a7249c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:55.250914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea84e0-18ed-4a5d-80f7-8ad7574b4760 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:55.265472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a22538-c81c-490b-b5da-b6ef51c99c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:55.266248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a22538-c81c-490b-b5da-b6ef51c99c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.266714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a22538-c81c-490b-b5da-b6ef51c99c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.267057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a22538-c81c-490b-b5da-b6ef51c99c9d admin admin] PATH_INFO: `/v3/projects/815730176fea49899b50491207b43684/users/4d5e2e678f324d40b6f7a99f05a8e54c/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.271067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a22538-c81c-490b-b5da-b6ef51c99c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=815730176fea49899b50491207b43684, user_id=4d5e2e678f324d40b6f7a99f05a8e54c, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:55.275457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a22538-c81c-490b-b5da-b6ef51c99c9d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:55.299419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 813/1632] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:55 2022] PUT /identity/v3/projects/815730176fea49899b50491207b43684/users/4d5e2e678f324d40b6f7a99f05a8e54c/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:55.309792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ef30-ca20-4632-998c-8c9248444cc2 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.312553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e5e0d-86a7-467f-bad7-0553e8a7249c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:55.313322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ef30-ca20-4632-998c-8c9248444cc2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.314907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ef30-ca20-4632-998c-8c9248444cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.365882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:55.373651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cf10ef30-ca20-4632-998c-8c9248444cc2 None None] MFA Rules not processed for user `4d5e2e678f324d40b6f7a99f05a8e54c`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:55.375071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cf10ef30-ca20-4632-998c-8c9248444cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:55.378030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:55.378857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.379484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.382690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.490631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 814/1633] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:55.490631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3caf9-dfae-42ff-ab85-c7be7fcecd1d None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.490631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3caf9-dfae-42ff-ab85-c7be7fcecd1d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.490631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3caf9-dfae-42ff-ab85-c7be7fcecd1d None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.491165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 815/1634] 10.222.0.58 () {54 vars in 912 bytes} [Thu Jul 28 06:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:32:55.496622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad7dac-4f7e-4a87-9e26-58a664670d39 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.497023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad7dac-4f7e-4a87-9e26-58a664670d39 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.497388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad7dac-4f7e-4a87-9e26-58a664670d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.500420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:55.502053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:55.513568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 820/1635] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:32:55.514782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:55.527290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc015-8bfe-46e4-bb6a-9e270b0efd72 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:55.533347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:55.534002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.534368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.535322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.549790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:55.551303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-13ad7dac-4f7e-4a87-9e26-58a664670d39 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:55.552774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:55.553004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-13ad7dac-4f7e-4a87-9e26-58a664670d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:55.586233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 821/1636] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:55.712987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:55.716392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:55.733859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bc1bf-7d11-4aae-a1d3-12c58543adf9 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:55.735775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 816/1637] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:32:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:55.750484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:55.751512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.752124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.752293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.761027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad7dac-4f7e-4a87-9e26-58a664670d39 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:55.878292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:55.881243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:55.921160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 822/1638] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:32:55.924356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:55.948205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1d9b6-9d2a-4f03-b919-eb24a5b0d096 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:55.960700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28460862-39d7-46ba-9521-948e42e73d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:55.961478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28460862-39d7-46ba-9521-948e42e73d9c service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:55.961816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28460862-39d7-46ba-9521-948e42e73d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:55.962166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28460862-39d7-46ba-9521-948e42e73d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:55.997915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28460862-39d7-46ba-9521-948e42e73d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:56.001827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28460862-39d7-46ba-9521-948e42e73d9c service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:56.007656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad7dac-4f7e-4a87-9e26-58a664670d39 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:56.033390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:56.037267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:56.037551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:56.041120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] PATH_INFO: `/v3/users/d6adc20fc5b74905ad503a3fc9a47f25` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:56.047724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6adc20fc5b74905ad503a3fc9a47f25)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:56.050279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: WARNING py.warnings [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:32:56.050279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: warnings.warn(msg) Jul 28 06:32:56.050279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: Jul 28 06:32:56.056351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:56.057790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 823/1639] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:56.252535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6adc20fc5b74905ad503a3fc9a47f25'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:56.319226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6adc20fc5b74905ad503a3fc9a47f25'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:56.339120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6adc20fc5b74905ad503a3fc9a47f25'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:56.339995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6adc20fc5b74905ad503a3fc9a47f25'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:56.370287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6adc20fc5b74905ad503a3fc9a47f25'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:56.385022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 817/1640] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:32:55 2022] DELETE /identity/v3/users/d6adc20fc5b74905ad503a3fc9a47f25 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:56.387129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d41b3c-abea-44a5-8114-0edcf73a66e0 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:56.387718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d41b3c-abea-44a5-8114-0edcf73a66e0 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:56.388241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d41b3c-abea-44a5-8114-0edcf73a66e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:56.442580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-37d41b3c-abea-44a5-8114-0edcf73a66e0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:56.453618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-37d41b3c-abea-44a5-8114-0edcf73a66e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:56.665745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 824/1641] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:56.700753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:56.702898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:56.821441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b20f-a1bb-4e7d-a341-2b0935c207d6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:56.836056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:56.837341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:56.837826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:56.838359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:56.855876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:56.857717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:56.881936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 818/1642] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:32:57.715758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea384d-10bf-48bc-bf5b-51d10a878d5a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:57.716272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea384d-10bf-48bc-bf5b-51d10a878d5a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:57.716437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea384d-10bf-48bc-bf5b-51d10a878d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:57.726633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:57.801742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4cea384d-10bf-48bc-bf5b-51d10a878d5a None None] MFA Rules not processed for user `63fe53c8b34a4ff19e8712c3bed6b274`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:57.806484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4cea384d-10bf-48bc-bf5b-51d10a878d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:57.985961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 825/1643] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:32:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:57.990274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:57.991773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:58.022726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97f0c-af26-424e-be6d-f2088152930e service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:58.046203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ff48e-5109-45c8-b84c-9a2861bdde0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:58.046865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ff48e-5109-45c8-b84c-9a2861bdde0d admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.047902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ff48e-5109-45c8-b84c-9a2861bdde0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.048191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ff48e-5109-45c8-b84c-9a2861bdde0d admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.048906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ff48e-5109-45c8-b84c-9a2861bdde0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:58.058695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ff48e-5109-45c8-b84c-9a2861bdde0d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:58.109869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:58.151118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 819/1644] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:32:57 2022] POST /identity/v3/projects => generated 403 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:58.154089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea384d-10bf-48bc-bf5b-51d10a878d5a None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:58.172062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea384d-10bf-48bc-bf5b-51d10a878d5a None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:58.203576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcf203-4c34-4738-9732-8b67345ad7eb None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.204361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcf203-4c34-4738-9732-8b67345ad7eb None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.204811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcf203-4c34-4738-9732-8b67345ad7eb None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.206389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 820/1645] 10.222.0.58 () {54 vars in 962 bytes} [Thu Jul 28 06:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:32:58.230954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa5f3-086a-4f60-af5c-1222dc209a06 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.231411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa5f3-086a-4f60-af5c-1222dc209a06 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.231715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa5f3-086a-4f60-af5c-1222dc209a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.286435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-c1efa5f3-086a-4f60-af5c-1222dc209a06 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:58.290678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c1efa5f3-086a-4f60-af5c-1222dc209a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:58.329128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:58.331118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.331509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.332229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.334754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:58.340741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:58.397840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 826/1646] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:32:58 2022] POST /identity/v3/users => generated 308 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:32:58.399243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:58.419329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385b38-c14e-4acb-a82c-1ccc948c2afc admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:58.433044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:58.433861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.434667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.435007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.435868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:58.441314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:58.453173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 821/1647] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Jul 28 06:32:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:32:58.463548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc38d-09f2-42c7-af1d-502e339ad57a None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.465188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc38d-09f2-42c7-af1d-502e339ad57a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.465480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc38d-09f2-42c7-af1d-502e339ad57a None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.469286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 827/1648] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:58.470373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:58.472784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 822/1649] 10.222.0.58 () {54 vars in 912 bytes} [Thu Jul 28 06:32:58 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:32:58.480352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.480649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.480910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.495762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e5411-cbab-4bfc-861c-b4e278ca2932 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:58.507749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:58.508645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.509018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.509457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] PATH_INFO: `/v3/projects/1be36536a7be4bebbedd6ff3549faf9e/users/6b3c808dfa4e4635b1cba81449abde75/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.545271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be36536a7be4bebbedd6ff3549faf9e, user_id=6b3c808dfa4e4635b1cba81449abde75, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:58.548606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:58.561194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:32:58.567677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:58.587597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 828/1650] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:58 2022] PUT /identity/v3/projects/1be36536a7be4bebbedd6ff3549faf9e/users/6b3c808dfa4e4635b1cba81449abde75/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:58.589701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:58.712899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:58.732375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 823/1651] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:32:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:32:58.747264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd3a1-b414-4024-8d95-fccc8661f344 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:58.749846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:58.751657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:58.765182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:58.765842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.766125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.766403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.767120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:58.768769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:58.820959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 829/1652] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:32:58.825961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:58.838019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:58.874601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218522f7-dfe6-431b-b014-a961a1d94548 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:58.890780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:58.891606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.891935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.894646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] PATH_INFO: `/v3/projects/65f9c54a34c2404dbb973620e3fd8b48` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:58.899954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f9c54a34c2404dbb973620e3fd8b48)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:58.904504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: WARNING py.warnings [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:32:58.904504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: warnings.warn(msg) Jul 28 06:32:58.904504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: Jul 28 06:32:58.906425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:58.942024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466a190-011d-48b3-b422-2b1bd8e2bf8f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:58.956541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:58.959580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:58.959891 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:58.960168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:59.031990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:59.039926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:59.081016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 824/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:32:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:32:59.095224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:59.101878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f9c54a34c2404dbb973620e3fd8b48', 'request_id': 'req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.127921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f9c54a34c2404dbb973620e3fd8b48', 'request_id': 'req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.131248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfd530-0010-44a7-a991-276859d11146 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:59.153286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f9c54a34c2404dbb973620e3fd8b48', 'request_id': 'req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.176102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] The token cache is being invalidate because project 65f9c54a34c2404dbb973620e3fd8b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:32:59.176419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.179722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.185549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 830/1654] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:32:58 2022] DELETE /identity/v3/projects/65f9c54a34c2404dbb973620e3fd8b48 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:59.186690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:32:59.191349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:32:59.206406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:59.326173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:59.328627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:59.330698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:59.331021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] PATH_INFO: `/v3/projects/1be36536a7be4bebbedd6ff3549faf9e/users/6b3c808dfa4e4635b1cba81449abde75/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:59.336640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be36536a7be4bebbedd6ff3549faf9e, user_id=6b3c808dfa4e4635b1cba81449abde75, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:59.339920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:59.362220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69750a41-3e3e-4a05-b2cf-32fffca7f0d7 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:32:59.370493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 825/1655] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:32:59 2022] PUT /identity/v3/projects/1be36536a7be4bebbedd6ff3549faf9e/users/6b3c808dfa4e4635b1cba81449abde75/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:32:59.517961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:32:59.518889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:32:59.519179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:32:59.519465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] PATH_INFO: `/v3/users/4d5e2e678f324d40b6f7a99f05a8e54c` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:32:59.521057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5e2e678f324d40b6f7a99f05a8e54c)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:32:59.524094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:32:59.559873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:59.630425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5e2e678f324d40b6f7a99f05a8e54c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.652522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5e2e678f324d40b6f7a99f05a8e54c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.653696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5e2e678f324d40b6f7a99f05a8e54c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.672872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5e2e678f324d40b6f7a99f05a8e54c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.685964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ca033cfe-8b9d-4131-afa9-ee465260aad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5e2e678f324d40b6f7a99f05a8e54c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:32:59.712157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 831/1656] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:32:59 2022] DELETE /identity/v3/users/4d5e2e678f324d40b6f7a99f05a8e54c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:02.081737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:02.083536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:02.108548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494a8b8-ad19-4fd4-b5aa-fcc9edee0af6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:02.249343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:02.250240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:02.250990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:02.251277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] PATH_INFO: `/v3/projects/815730176fea49899b50491207b43684` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:02.253989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=815730176fea49899b50491207b43684)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:02.258201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:02.458238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815730176fea49899b50491207b43684', 'request_id': 'req-0d692d30-08c9-4588-b43c-281c76ccf88b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:02.511464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815730176fea49899b50491207b43684', 'request_id': 'req-0d692d30-08c9-4588-b43c-281c76ccf88b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:02.561883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815730176fea49899b50491207b43684', 'request_id': 'req-0d692d30-08c9-4588-b43c-281c76ccf88b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:02.593729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] The token cache is being invalidate because project 815730176fea49899b50491207b43684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:02.595260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:02.598235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d692d30-08c9-4588-b43c-281c76ccf88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:02.608707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 826/1657] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:02 2022] DELETE /identity/v3/projects/815730176fea49899b50491207b43684 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:02.610905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9ec4-7296-444f-8e8e-e70be07280ba None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:02.611382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9ec4-7296-444f-8e8e-e70be07280ba None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:02.611450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9ec4-7296-444f-8e8e-e70be07280ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:02.672812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-8c9a9ec4-7296-444f-8e8e-e70be07280ba None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:02.674088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8c9a9ec4-7296-444f-8e8e-e70be07280ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:02.864129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 832/1658] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:02.865845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f32de-b19b-4f98-b051-beb0bbf583cd None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:02.866230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f32de-b19b-4f98-b051-beb0bbf583cd None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:02.866681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f32de-b19b-4f98-b051-beb0bbf583cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:02.899327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7d7f32de-b19b-4f98-b051-beb0bbf583cd None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:02.902817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7d7f32de-b19b-4f98-b051-beb0bbf583cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:02.922402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 827/1659] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:02.927578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9ec4-7296-444f-8e8e-e70be07280ba None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:02.940723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9ec4-7296-444f-8e8e-e70be07280ba None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:02.947602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:02.948278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:02.948564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:02.952178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:02.953048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:02.953371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:02.955017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:02.994816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 833/1660] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:02.999022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f32de-b19b-4f98-b051-beb0bbf583cd None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:03.015733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f32de-b19b-4f98-b051-beb0bbf583cd None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:03.045949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:03.047440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.056527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.056895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.060732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:03.063472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:03.134179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 828/1661] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:02 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:03.139170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:03.155102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4305b2e-ab55-49c1-93fb-fdda300a1b84 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:03.308797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b16f1e-347b-4466-9669-0765239eb453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:03.311462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16f1e-347b-4466-9669-0765239eb453 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.312395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16f1e-347b-4466-9669-0765239eb453 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.313194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16f1e-347b-4466-9669-0765239eb453 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.314060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b16f1e-347b-4466-9669-0765239eb453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:03.316259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b16f1e-347b-4466-9669-0765239eb453 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:03.365869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 834/1662] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:03 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:03.367672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:03.385076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.385076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.385455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.397164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dca73-55a7-49df-847f-0a59f4d53129 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:03.423060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:03.423060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.423060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.423060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.423309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:03.424964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:03.469206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 829/1663] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:03.470120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:03.471807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:03.485314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] MFA Rules not processed for user `270693550b1e4d4888290abe6030b108`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:03.486339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:03.497236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6775baf-bffa-401d-8b09-23f9b49c63c7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:03.507660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:03.510424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.510719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.512009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.513202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:03.516255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:03.518358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:03.541179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 830/1664] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:03.542553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:03.558000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755787b4-645d-4ae7-b8b0-d6f2b723b87f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:03.564779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0da2-d88c-4ade-b4b7-e53aa5a2f9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:03.565860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0da2-d88c-4ade-b4b7-e53aa5a2f9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.566273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0da2-d88c-4ade-b4b7-e53aa5a2f9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.567324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0da2-d88c-4ade-b4b7-e53aa5a2f9b5 admin admin] PATH_INFO: `/v3/projects/bba8bea0396044baa2fc397e13d2831b/users/6ab4cc22f1f64edfb6b9b53fa37961a5/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.600285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0da2-d88c-4ade-b4b7-e53aa5a2f9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba8bea0396044baa2fc397e13d2831b, user_id=6ab4cc22f1f64edfb6b9b53fa37961a5, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:03.604896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0da2-d88c-4ade-b4b7-e53aa5a2f9b5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:03.662669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 831/1665] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:03 2022] PUT /identity/v3/projects/bba8bea0396044baa2fc397e13d2831b/users/6ab4cc22f1f64edfb6b9b53fa37961a5/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:03.674457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e1d9-6ecd-41e4-8b0c-2a6a8a0a8238 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.674457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e1d9-6ecd-41e4-8b0c-2a6a8a0a8238 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.674738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e1d9-6ecd-41e4-8b0c-2a6a8a0a8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.685441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 835/1666] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:03.699976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:03.703834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:03.776679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1655e1d9-6ecd-41e4-8b0c-2a6a8a0a8238 None None] MFA Rules not processed for user `6ab4cc22f1f64edfb6b9b53fa37961a5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:03.777921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1655e1d9-6ecd-41e4-8b0c-2a6a8a0a8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:03.934518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 832/1667] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:03.934518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:03.934518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:03.934518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:03.936242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0ffd-20e0-4d23-90d8-9f48b1698c28 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:04.010764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] MFA Rules not processed for user `6b3c808dfa4e4635b1cba81449abde75`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:04.011979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:04.079688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:04.080592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.081146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.081723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.169881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:04.232386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:04.234007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:04.261847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 836/1668] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:04.262706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:04.289120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 833/1669] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:04.290470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:04.292444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:04.335439 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488b5f1-e879-4355-b5c2-a58dc63f6ea3 service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:04.340358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:04.341002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.341279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.341556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.342228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:04.344180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:04.398909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 837/1670] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:04 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:04.400087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:04.464825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:04.504412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649dfb1-f776-4de4-9404-491f27294604 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:04.510628 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:04.511330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.511765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.511990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.512732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:04.514911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:04.524073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84834-5427-456f-a347-4c1e6b15c2c9 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:04.551048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:04.551970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.552174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.552452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] PATH_INFO: `/v3/users/bcdd12eeacba4ab18294b7822b4a0a0c` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.555995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 838/1671] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:04 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:04.556875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:04.560496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcdd12eeacba4ab18294b7822b4a0a0c)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:04.562679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:04.577120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ff7f-e8f4-4b24-894a-f43371923e44 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:04.583954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:04.584606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.584889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.585168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.585868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:04.595905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:04.618309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 839/1672] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:04.624075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:04.643270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc3c1e-1ed6-4f61-be6f-fdaf73bb3f7a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:04.652324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:04.653060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.653346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.653624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.654575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:04.655964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:04.681071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 840/1673] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:04.691090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:04.724446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42cef3-f6de-4bde-bb9b-9073e6d310a4 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:04.727357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcdd12eeacba4ab18294b7822b4a0a0c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:04.740525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bbac8-db5f-4a74-a4a9-a34814baf61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:04.744700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bbac8-db5f-4a74-a4a9-a34814baf61a admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.744988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bbac8-db5f-4a74-a4a9-a34814baf61a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.745314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bbac8-db5f-4a74-a4a9-a34814baf61a admin admin] PATH_INFO: `/v3/projects/b723f1439ec340b3a60098f0af284991/users/86ec80dd4ec24520b0c5d62f810b7aab/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.768154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcdd12eeacba4ab18294b7822b4a0a0c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:04.780000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcdd12eeacba4ab18294b7822b4a0a0c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:04.782309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcdd12eeacba4ab18294b7822b4a0a0c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:04.783960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bbac8-db5f-4a74-a4a9-a34814baf61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b723f1439ec340b3a60098f0af284991, user_id=86ec80dd4ec24520b0c5d62f810b7aab, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:04.787849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bbac8-db5f-4a74-a4a9-a34814baf61a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:04.809388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-75e2b835-4475-473e-bec0-e9d712c573e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcdd12eeacba4ab18294b7822b4a0a0c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:04.819052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 834/1674] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:04 2022] DELETE /identity/v3/users/bcdd12eeacba4ab18294b7822b4a0a0c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:04.822520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 841/1675] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:04 2022] PUT /identity/v3/projects/b723f1439ec340b3a60098f0af284991/users/86ec80dd4ec24520b0c5d62f810b7aab/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:04.823741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.824235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.824728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.834283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:04.834582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:04.834848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:04.851447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:04.881925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:04.883366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:04.898164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] MFA Rules not processed for user `86ec80dd4ec24520b0c5d62f810b7aab`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:04.899475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:05.047761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 835/1676] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:05.065277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 842/1677] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:05.069700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:05.071687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:05.077620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:05.080650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:05.093718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14274e9-9273-49c2-b1c3-83781e3bf317 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:05.101811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:05.102575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.104189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.106512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:05.107310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:05.111886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:05.217858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ba678-6a0b-4130-aba1-9a8d1608ae7c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:05.219316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 836/1678] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:05 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:05.226532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:05.343818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:05.352563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:05.353240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.353683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.353861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:05.391758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d691a8-3bfb-4bdc-8d51-2bb7c09cd500 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:05.409036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:05.409691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.409971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.410244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:05.410939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:05.412936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:05.471112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 837/1679] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:05 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:05.476867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:05.498911 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce4e9b-2a7b-4e7d-8be3-1f69290edd38 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:05.518843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:05.519590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.519900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.520174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:05.520968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:05.522551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:05.527077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:05.528565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:05.538479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:05.547554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 838/1680] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:05.551573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 843/1681] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:05.558160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:05.593096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5a8f3-d4ec-475f-b1cd-27e9a97da24b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:05.602480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:05.604435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.604799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.605178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] PATH_INFO: `/v3/projects/10485ad1a0624bf28ce269c6345e853b/users/1a9486ac45184d63b29177d983f5d81c/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:05.631464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10485ad1a0624bf28ce269c6345e853b, user_id=1a9486ac45184d63b29177d983f5d81c, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:05.635955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:05.669053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 839/1682] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:05 2022] PUT /identity/v3/projects/10485ad1a0624bf28ce269c6345e853b/users/1a9486ac45184d63b29177d983f5d81c/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:05.670136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:05.684889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f00dc5-cd20-492f-b3a9-8cb01adb66ff service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:05.837115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594d75-b98c-4824-8189-88dfcf36a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:05.837856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594d75-b98c-4824-8189-88dfcf36a261 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.838128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594d75-b98c-4824-8189-88dfcf36a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.838383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594d75-b98c-4824-8189-88dfcf36a261 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:05.839095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594d75-b98c-4824-8189-88dfcf36a261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:05.840807 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594d75-b98c-4824-8189-88dfcf36a261 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:05.863783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 844/1683] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:33:05.865186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:05.887707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012be7b2-93d4-4aa7-ab3d-9e4098469eb0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:05.904491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:05.905235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.905517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.905784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] PATH_INFO: `/v3/projects/10485ad1a0624bf28ce269c6345e853b/users/1a9486ac45184d63b29177d983f5d81c/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:05.907944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10485ad1a0624bf28ce269c6345e853b, user_id=1a9486ac45184d63b29177d983f5d81c, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:05.910679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:05.958191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 840/1684] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:05 2022] PUT /identity/v3/projects/10485ad1a0624bf28ce269c6345e853b/users/1a9486ac45184d63b29177d983f5d81c/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:05.960106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:05.960405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:05.960707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:06.018181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] MFA Rules not processed for user `1a9486ac45184d63b29177d983f5d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:06.019434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:06.256638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 845/1685] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:06.273087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:06.275639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:06.435411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6c31-7248-42dd-85aa-7778c29c1542 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:06.447759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff167667-9485-4005-adc8-f3708b90f1c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:06.448942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff167667-9485-4005-adc8-f3708b90f1c2 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:06.449231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff167667-9485-4005-adc8-f3708b90f1c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:06.449502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff167667-9485-4005-adc8-f3708b90f1c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:06.479460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff167667-9485-4005-adc8-f3708b90f1c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:06.479727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:06.481327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff167667-9485-4005-adc8-f3708b90f1c2 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:06.481930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:06.500991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 841/1686] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:06.703965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c83f-65ce-40df-843d-4c5a82e7de03 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:06.712651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:06.713987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:06.714273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:06.714555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] PATH_INFO: `/v3/users/7c7a79e850e04b918862c6dfcf2ea999` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:06.715914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7a79e850e04b918862c6dfcf2ea999)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:06.721036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:06.838554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:06.921517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7a79e850e04b918862c6dfcf2ea999'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:06.963372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7a79e850e04b918862c6dfcf2ea999'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:06.964687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7a79e850e04b918862c6dfcf2ea999'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:06.985839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7a79e850e04b918862c6dfcf2ea999'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:06.996953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7a79e850e04b918862c6dfcf2ea999'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:07.014249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 846/1687] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:06 2022] DELETE /identity/v3/users/7c7a79e850e04b918862c6dfcf2ea999 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:07.018467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdfee0-f585-4f73-a12b-e133a6262b56 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:07.018743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdfee0-f585-4f73-a12b-e133a6262b56 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:07.019599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdfee0-f585-4f73-a12b-e133a6262b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:07.065353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-70cdfee0-f585-4f73-a12b-e133a6262b56 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:07.069674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-70cdfee0-f585-4f73-a12b-e133a6262b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:07.246387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 842/1688] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:07.319394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:07.320849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:07.452933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2603b-0d79-459a-88be-ef68d2a5b8e3 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:07.457426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:07.458403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:07.459310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:07.459832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:07.477712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:07.482903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:07.542122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 847/1689] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:07.559970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2120b0-6df7-49b7-8f04-f3ea968e5c2d None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:07.560984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2120b0-6df7-49b7-8f04-f3ea968e5c2d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:07.561533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2120b0-6df7-49b7-8f04-f3ea968e5c2d None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:07.564208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 843/1690] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:33:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:33:07.637831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:07.639477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:07.680935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649478-3a8d-4a65-8498-0078354025c8 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:07.684381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649478-3a8d-4a65-8498-0078354025c8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:07.684856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649478-3a8d-4a65-8498-0078354025c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:07.750671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-99649478-3a8d-4a65-8498-0078354025c8 None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:07.753362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-99649478-3a8d-4a65-8498-0078354025c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:07.824782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3656a6c-5971-446f-892e-cadad69a071d service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:07.827144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:07.836821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348caae-d034-4e9e-9854-e8e73e0c7265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:07.837476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348caae-d034-4e9e-9854-e8e73e0c7265 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:07.838101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348caae-d034-4e9e-9854-e8e73e0c7265 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:07.838684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348caae-d034-4e9e-9854-e8e73e0c7265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:07.842711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9348caae-d034-4e9e-9854-e8e73e0c7265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:07.948343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 844/1691] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:33:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:07.988583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348caae-d034-4e9e-9854-e8e73e0c7265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:07.991608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348caae-d034-4e9e-9854-e8e73e0c7265 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:07.995591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:08.018655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 848/1692] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:08.054583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0adc0c-7a53-463c-bcd1-cb41485dd500 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:08.055139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0adc0c-7a53-463c-bcd1-cb41485dd500 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:08.055693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0adc0c-7a53-463c-bcd1-cb41485dd500 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:08.058257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 845/1693] 10.222.0.58 () {54 vars in 961 bytes} [Thu Jul 28 06:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:33:08.069666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:08.069954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:08.070231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:08.114770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:08.114770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:08.140213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 849/1694] 10.222.0.58 () {58 vars in 1058 bytes} [Thu Jul 28 06:33:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:08.151783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0adc0c-7a53-463c-bcd1-cb41485dd500 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:08.174334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0adc0c-7a53-463c-bcd1-cb41485dd500 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:08.188710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59844966-3ea3-4bbf-a6dd-a6aa12f5f8fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:08.189364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844966-3ea3-4bbf-a6dd-a6aa12f5f8fb service placement] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:08.189644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844966-3ea3-4bbf-a6dd-a6aa12f5f8fb service placement] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:08.189919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844966-3ea3-4bbf-a6dd-a6aa12f5f8fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:08.211748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59844966-3ea3-4bbf-a6dd-a6aa12f5f8fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:08.213409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59844966-3ea3-4bbf-a6dd-a6aa12f5f8fb service placement] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:08.263379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 846/1695] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:08.636180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:08.637796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:08.661867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77116fe7-1874-4fb6-a1d6-78c8760ceed9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:08.668517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:08.670205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:08.670654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:08.671125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] PATH_INFO: `/v3/projects/09851b8f35a1425c9290a0b3110874fc` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:08.672612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] RBAC: Authorizing `identity:delete_project(project_id=09851b8f35a1425c9290a0b3110874fc)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:08.674781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:08.878260 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09851b8f35a1425c9290a0b3110874fc', 'request_id': 'req-3a165bf4-11bc-471b-bbce-d73be581bcac'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:08.890984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09851b8f35a1425c9290a0b3110874fc', 'request_id': 'req-3a165bf4-11bc-471b-bbce-d73be581bcac'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:08.912345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09851b8f35a1425c9290a0b3110874fc', 'request_id': 'req-3a165bf4-11bc-471b-bbce-d73be581bcac'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:08.932319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] The token cache is being invalidate because project 09851b8f35a1425c9290a0b3110874fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:08.932319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:08.935434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a165bf4-11bc-471b-bbce-d73be581bcac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:08.940854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 850/1696] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:08 2022] DELETE /identity/v3/projects/09851b8f35a1425c9290a0b3110874fc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:08.949413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d11e6-efdc-412e-bf42-bbee5be1e812 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:08.951480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d11e6-efdc-412e-bf42-bbee5be1e812 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:08.951976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d11e6-efdc-412e-bf42-bbee5be1e812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:09.036750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a29d11e6-efdc-412e-bf42-bbee5be1e812 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:09.041255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a29d11e6-efdc-412e-bf42-bbee5be1e812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:09.278505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 847/1697] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:09.279757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0050-04d3-4432-abae-063a38404497 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:09.280187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0050-04d3-4432-abae-063a38404497 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:09.280464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0050-04d3-4432-abae-063a38404497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:09.330818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-700d0050-04d3-4432-abae-063a38404497 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:09.332869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-700d0050-04d3-4432-abae-063a38404497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:09.354960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 851/1698] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:09.356608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d11e6-efdc-412e-bf42-bbee5be1e812 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:09.367305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d11e6-efdc-412e-bf42-bbee5be1e812 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:09.382754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:09.383412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:09.383729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:09.384194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:09.385090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:09.385528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:09.388552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:09.409584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 848/1699] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:33:09.412138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0050-04d3-4432-abae-063a38404497 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:09.424801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0050-04d3-4432-abae-063a38404497 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:09.431795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:09.432024 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:09.432305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:09.432680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:09.433642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:09.435937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:09.519606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 852/1700] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:09 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:09.523522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:09.540863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bdd2e-b7ed-46d5-9398-b5aee5db3694 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:09.574359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:09.576609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:09.669917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:09.670751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:09.673150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:09.673811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:09.674371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:09.679467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:09.704732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9e8b4-0a6c-468a-a5aa-07b3657cddbb admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:09.715837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 849/1701] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:09 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:09.715837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:09.719523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:09.720245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:09.720466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:09.720572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:09.720854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] PATH_INFO: `/v3/users/63fe53c8b34a4ff19e8712c3bed6b274` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:09.722137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fe53c8b34a4ff19e8712c3bed6b274)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:09.724232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:09.742062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f95f1-a4a0-4e26-bef7-808f20382cdd admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:09.750751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:09.751907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:09.751907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:09.752566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] PATH_INFO: `/v3/projects/3b079157c1414b53b49b8b9410b7bf35` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:09.754017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b079157c1414b53b49b8b9410b7bf35)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:09.756371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:09.822594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:09.835761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fe53c8b34a4ff19e8712c3bed6b274'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.837279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:09.860101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fe53c8b34a4ff19e8712c3bed6b274'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.860861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fe53c8b34a4ff19e8712c3bed6b274'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.887462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fe53c8b34a4ff19e8712c3bed6b274'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.900369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fe53c8b34a4ff19e8712c3bed6b274'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.910970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 853/1702] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:09 2022] DELETE /identity/v3/users/63fe53c8b34a4ff19e8712c3bed6b274 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:09.911789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:09.914381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:09.928292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b079157c1414b53b49b8b9410b7bf35', 'request_id': 'req-4a1683e3-ae4c-42c8-95af-4e269995b8ec'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.946199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b079157c1414b53b49b8b9410b7bf35', 'request_id': 'req-4a1683e3-ae4c-42c8-95af-4e269995b8ec'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.960376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b079157c1414b53b49b8b9410b7bf35', 'request_id': 'req-4a1683e3-ae4c-42c8-95af-4e269995b8ec'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.981255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] The token cache is being invalidate because project 3b079157c1414b53b49b8b9410b7bf35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:09.982100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.982989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:09.985521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 850/1703] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:09 2022] DELETE /identity/v3/projects/3b079157c1414b53b49b8b9410b7bf35 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:09.990188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:09.993065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:10.079172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e9de-ddc9-4587-abb2-1c92cc4a302b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:10.093620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:10.094281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:10.094666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:10.094926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:10.095766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:10.097407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:10.121254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 854/1704] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:10.125022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:10.127322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:10.131941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1683e3-ae4c-42c8-95af-4e269995b8ec admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:10.139260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:10.140077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:10.140356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:10.140628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] PATH_INFO: `/v3/users/058a8bd6cd204dce920e6853f382fdb6` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:10.141841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058a8bd6cd204dce920e6853f382fdb6)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:10.144785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:10.150618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c397-8765-4cf8-a286-5e1c16fd5c37 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:10.164444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:10.165321 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:10.165607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:10.165936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:10.166649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:10.168317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:10.201093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 855/1705] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:33:10.203004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:10.229783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b14383-8ee7-4fa9-8496-07fd0884d35f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:10.238827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058a8bd6cd204dce920e6853f382fdb6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:10.256419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43de21-2b1b-49b8-900e-79d5036bc534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:10.257289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43de21-2b1b-49b8-900e-79d5036bc534 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:10.257582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43de21-2b1b-49b8-900e-79d5036bc534 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:10.257861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43de21-2b1b-49b8-900e-79d5036bc534 admin admin] PATH_INFO: `/v3/projects/cdf06133defe40af8121988c4bc1c0d8/users/ac05d284ca5143b19b91648bbde80a84/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:10.267466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058a8bd6cd204dce920e6853f382fdb6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:10.283495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058a8bd6cd204dce920e6853f382fdb6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:10.284640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058a8bd6cd204dce920e6853f382fdb6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:10.306653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43de21-2b1b-49b8-900e-79d5036bc534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf06133defe40af8121988c4bc1c0d8, user_id=ac05d284ca5143b19b91648bbde80a84, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:10.309372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43de21-2b1b-49b8-900e-79d5036bc534 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:10.320204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058a8bd6cd204dce920e6853f382fdb6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:10.350016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 856/1706] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:10 2022] PUT /identity/v3/projects/cdf06133defe40af8121988c4bc1c0d8/users/ac05d284ca5143b19b91648bbde80a84/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:10.366343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 851/1707] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:09 2022] DELETE /identity/v3/users/058a8bd6cd204dce920e6853f382fdb6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:10.367145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae0adf-2999-473d-b3ec-125488321636 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:10.367437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae0adf-2999-473d-b3ec-125488321636 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:10.367864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae0adf-2999-473d-b3ec-125488321636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:10.413471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-27ae0adf-2999-473d-b3ec-125488321636 None None] MFA Rules not processed for user `ac05d284ca5143b19b91648bbde80a84`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:10.414604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-27ae0adf-2999-473d-b3ec-125488321636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:10.512795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 857/1708] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:10.528989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:10.533601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:10.633746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:10.712469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4725b-ab2c-42d4-ab93-88508f3a0103 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:10.720179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:10.720589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:10.720889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:10.721166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:10.732454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:10.734701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:10.750582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 852/1709] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:11.627088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934347c-bc80-4523-b8a7-23e63e441ce3 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:11.628592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934347c-bc80-4523-b8a7-23e63e441ce3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:11.630037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934347c-bc80-4523-b8a7-23e63e441ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:11.698734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:11.700678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:11.720422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7934347c-bc80-4523-b8a7-23e63e441ce3 None None] MFA Rules not processed for user `270693550b1e4d4888290abe6030b108`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:11.729831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7934347c-bc80-4523-b8a7-23e63e441ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:11.793815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:11.931277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ce583-e5c4-4bf5-a2f3-57395f156246 service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:11.937315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:11.938736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:11.938844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:11.939036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] PATH_INFO: `/v3/projects/c4e2fd8c0cf5454abdc63087bd647a25` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:11.940547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e2fd8c0cf5454abdc63087bd647a25)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:11.956980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:11.992513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 858/1710] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:11.994797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256c03-3d11-4c82-bac7-213fd305c47b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:11.995357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256c03-3d11-4c82-bac7-213fd305c47b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:11.995954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256c03-3d11-4c82-bac7-213fd305c47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:12.046305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-19256c03-3d11-4c82-bac7-213fd305c47b None None] MFA Rules not processed for user `ec303a823f554fae8e5faf6f1e3df154`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:12.047851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-19256c03-3d11-4c82-bac7-213fd305c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.092801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e2fd8c0cf5454abdc63087bd647a25', 'request_id': 'req-dad6c3f1-5a0e-42c0-bd3b-260282a42561'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.108580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e2fd8c0cf5454abdc63087bd647a25', 'request_id': 'req-dad6c3f1-5a0e-42c0-bd3b-260282a42561'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.135154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e2fd8c0cf5454abdc63087bd647a25', 'request_id': 'req-dad6c3f1-5a0e-42c0-bd3b-260282a42561'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.160434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] The token cache is being invalidate because project c4e2fd8c0cf5454abdc63087bd647a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:12.160581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.167114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.171473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 853/1711] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:11 2022] DELETE /identity/v3/projects/c4e2fd8c0cf5454abdc63087bd647a25 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:12.176735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:12.180187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.203594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 859/1712] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:12.205185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732603ce-6c15-4dc9-a614-86800ebf0b3e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:12.205479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732603ce-6c15-4dc9-a614-86800ebf0b3e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:12.205761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732603ce-6c15-4dc9-a614-86800ebf0b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:12.259791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-732603ce-6c15-4dc9-a614-86800ebf0b3e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:12.261544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-732603ce-6c15-4dc9-a614-86800ebf0b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.309798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:12.335866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6c3f1-5a0e-42c0-bd3b-260282a42561 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:12.344017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:12.344979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:12.345515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:12.346510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] PATH_INFO: `/v3/projects/35cdaa57d74941b4b0afef726661b813` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:12.348666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cdaa57d74941b4b0afef726661b813)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:12.354029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:12.413373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 860/1713] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:12.416396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b5bb-6383-4183-a9f7-0df1c1e0daf9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:12.416847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b5bb-6383-4183-a9f7-0df1c1e0daf9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:12.417323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b5bb-6383-4183-a9f7-0df1c1e0daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:12.458085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-bca2b5bb-6383-4183-a9f7-0df1c1e0daf9 None None] MFA Rules not processed for user `ec303a823f554fae8e5faf6f1e3df154`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:12.459557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bca2b5bb-6383-4183-a9f7-0df1c1e0daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.478624 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cdaa57d74941b4b0afef726661b813', 'request_id': 'req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.488448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cdaa57d74941b4b0afef726661b813', 'request_id': 'req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.510020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cdaa57d74941b4b0afef726661b813', 'request_id': 'req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.549072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] The token cache is being invalidate because project 35cdaa57d74941b4b0afef726661b813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:12.550426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.551123 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-46e8bcdf-8f7a-461d-abc7-21891e4ba9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.555601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 854/1714] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:12 2022] DELETE /identity/v3/projects/35cdaa57d74941b4b0afef726661b813 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:12.557084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:12.563352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:12.563662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:12.563972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:12.603574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 861/1715] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:12.605144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:12.605449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:12.605712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:12.646040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:12.649510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.659654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] MFA Rules not processed for user `900c6f2526c3496e9bc0d1a936bafb94`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:12.660962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.831566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 862/1716] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:12.832493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:12.833933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.847601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff134b4-17c4-49d9-9f9b-9894b83b198c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:12.853885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:12.854638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:12.855017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:12.855299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] PATH_INFO: `/v3/users/6b3c808dfa4e4635b1cba81449abde75` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:12.859836 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3c808dfa4e4635b1cba81449abde75)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:12.859971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 855/1717] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:12.859971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:12.860459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:12.863284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:12.967220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3c808dfa4e4635b1cba81449abde75'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:12.998267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3c808dfa4e4635b1cba81449abde75'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.001932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3c808dfa4e4635b1cba81449abde75'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.013580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3c808dfa4e4635b1cba81449abde75'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.050561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3c808dfa4e4635b1cba81449abde75'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.067037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:13.070953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 863/1718] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:12 2022] DELETE /identity/v3/users/6b3c808dfa4e4635b1cba81449abde75 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:13.071910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:13.076437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:13.082276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c6eb3-1957-4208-b1b9-2af928b3b115 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:13.245202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037dc64-c028-4723-a80b-05ad16471618 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:13.262018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8f7c-6e56-43ce-8cba-4f72340eb79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:13.262681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8f7c-6e56-43ce-8cba-4f72340eb79f admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.262968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8f7c-6e56-43ce-8cba-4f72340eb79f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.263248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8f7c-6e56-43ce-8cba-4f72340eb79f admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.264245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8f7c-6e56-43ce-8cba-4f72340eb79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:13.264500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8f7c-6e56-43ce-8cba-4f72340eb79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:13.266135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8f7c-6e56-43ce-8cba-4f72340eb79f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:13.302609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 864/1719] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:13.314013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757de0-7183-480e-a9b8-7825956d053a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.314301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757de0-7183-480e-a9b8-7825956d053a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.314579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757de0-7183-480e-a9b8-7825956d053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.319267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:13.320002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.320288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.320563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.325479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:13.332991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:13.358069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-22757de0-7183-480e-a9b8-7825956d053a None None] MFA Rules not processed for user `900c6f2526c3496e9bc0d1a936bafb94`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:13.359327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-22757de0-7183-480e-a9b8-7825956d053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:13.485235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 865/1720] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:13.489991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2774d-0cf4-43b4-a2ff-b73fcdeee5cf None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.489991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2774d-0cf4-43b4-a2ff-b73fcdeee5cf None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.489991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2774d-0cf4-43b4-a2ff-b73fcdeee5cf None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.491036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 866/1721] 10.222.0.58 () {54 vars in 912 bytes} [Thu Jul 28 06:33:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:33:13.492270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2774d-0cf4-43b4-a2ff-b73fcdeee5cf None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:13.498117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:13.500114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:13.506463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2774d-0cf4-43b4-a2ff-b73fcdeee5cf None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:13.513235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:13.513884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.514169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.514452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.515129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:13.517313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:13.526654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 856/1722] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:13.527991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:13.534602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:13.604845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 867/1723] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:13 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:13.610393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:13.615199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:13.755783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6652897-7231-4991-9909-ae2fbde7bed7 service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:13.779183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0a902-fea1-4118-a361-6347e108ea45 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:13.784315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:13.785056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.785427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.786866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] PATH_INFO: `/v3/projects/1be36536a7be4bebbedd6ff3549faf9e` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.788427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be36536a7be4bebbedd6ff3549faf9e)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:13.791093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:13.875291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be36536a7be4bebbedd6ff3549faf9e', 'request_id': 'req-c63dd529-f88b-4c8e-99ad-f6f949d24e58'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.883869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be36536a7be4bebbedd6ff3549faf9e', 'request_id': 'req-c63dd529-f88b-4c8e-99ad-f6f949d24e58'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.891180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:13.891913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.892378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.892741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.895153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:13.899371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be36536a7be4bebbedd6ff3549faf9e', 'request_id': 'req-c63dd529-f88b-4c8e-99ad-f6f949d24e58'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.924719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] The token cache is being invalidate because project 1be36536a7be4bebbedd6ff3549faf9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:13.925158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.926598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c63dd529-f88b-4c8e-99ad-f6f949d24e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:13.930262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 868/1724] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:13 2022] DELETE /identity/v3/projects/1be36536a7be4bebbedd6ff3549faf9e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:13.931817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ed78a-4eca-489d-b5aa-8184f283fa6b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:13.932113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ed78a-4eca-489d-b5aa-8184f283fa6b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:13.932386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ed78a-4eca-489d-b5aa-8184f283fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:13.950947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:14.013674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:14.042914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e55ed78a-4eca-489d-b5aa-8184f283fa6b None None] MFA Rules not processed for user `c206251915e74dba98b9422cf2f026d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:14.056086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e55ed78a-4eca-489d-b5aa-8184f283fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:14.132506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.134006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.159512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 857/1725] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:14.160206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.184701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 869/1726] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:33:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:14.186035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaab9c-4ea4-4dd4-83b5-f4205d849362 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.186314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaab9c-4ea4-4dd4-83b5-f4205d849362 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.186590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaab9c-4ea4-4dd4-83b5-f4205d849362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.192427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da438e79-73d5-49b7-86ec-8e8be10712e2 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.252830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-33aaab9c-4ea4-4dd4-83b5-f4205d849362 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:14.254090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-33aaab9c-4ea4-4dd4-83b5-f4205d849362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:14.339908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.340704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.340991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.341266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.341979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.344182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.383280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 870/1727] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:14.385585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df961e31-f7b6-4126-a9b3-97e3f48f0b07 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.386113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df961e31-f7b6-4126-a9b3-97e3f48f0b07 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.386488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df961e31-f7b6-4126-a9b3-97e3f48f0b07 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.392050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 858/1728] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:14 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:14.393220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.393567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 871/1729] 10.222.0.58 () {54 vars in 912 bytes} [Thu Jul 28 06:33:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:33:14.395752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6f6e4-3c1f-457e-a266-4f253ebc9071 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.396337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6f6e4-3c1f-457e-a266-4f253ebc9071 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.396714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6f6e4-3c1f-457e-a266-4f253ebc9071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.398694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:14.419383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71a29e-d6f6-481b-ad08-8cb098549dfc admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.425291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ab53-559c-4ae5-a17a-a02e487be1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.426210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ab53-559c-4ae5-a17a-a02e487be1ba service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.426818 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ab53-559c-4ae5-a17a-a02e487be1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.427186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ab53-559c-4ae5-a17a-a02e487be1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.447981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ab53-559c-4ae5-a17a-a02e487be1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.453158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ab53-559c-4ae5-a17a-a02e487be1ba service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.460431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5fa6f6e4-3c1f-457e-a266-4f253ebc9071 None None] MFA Rules not processed for user `f25041ca39b84b0b9a3b742d0e43e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:14.462513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5fa6f6e4-3c1f-457e-a266-4f253ebc9071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:14.476782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 859/1730] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:14.479771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9745-7db2-48cb-ac70-4107d6b9548d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.479771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9745-7db2-48cb-ac70-4107d6b9548d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.480011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9745-7db2-48cb-ac70-4107d6b9548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.536757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-425c9745-7db2-48cb-ac70-4107d6b9548d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:14.540442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-425c9745-7db2-48cb-ac70-4107d6b9548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:14.569626 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 860/1731] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:14.571241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.571526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.571942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.609993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] MFA Rules not processed for user `c206251915e74dba98b9422cf2f026d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:14.611281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:14.632783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 861/1732] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:33:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:14.634421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.637386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:14.646341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 872/1733] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:14.647509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6f6e4-3c1f-457e-a266-4f253ebc9071 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.668816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6f6e4-3c1f-457e-a266-4f253ebc9071 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.671218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ffc4-8f0c-4772-ad36-febf14c3eb14 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.679874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.680288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.681068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.681580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.682176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.682677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.682996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:14.683331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.683430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.683880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.684762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.685470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.686920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.712318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 873/1734] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:14.713734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.736860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 862/1735] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:14.742860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a61b-7540-444a-ba27-372bc8671fef admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.743595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.747885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.749088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.749369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.749650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.773921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.775597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.780940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a76f9d-cfef-4f94-8f79-47eb3a7f07ef admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.786908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.788113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.788397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 874/1736] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:14.789185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.789571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.789927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.791175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.793736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.839123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764685f-7496-4b40-9d0f-9457f63a6b08 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.848704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.849518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.849930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.850452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 863/1737] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:14 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:14.850571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.851361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:14.854544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.856630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:14.872288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 875/1738] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:14.877713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:14.886518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:14.891489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab5e09-dab7-43ab-a2ee-54fc34bcce9f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:14.989630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7f471-57ee-43d4-ba96-83862a29407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:14.990335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7f471-57ee-43d4-ba96-83862a29407b admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:14.990652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7f471-57ee-43d4-ba96-83862a29407b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:14.990953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7f471-57ee-43d4-ba96-83862a29407b admin admin] PATH_INFO: `/v3/projects/b983df2cad7649d5809cff0237d79409/users/047aad4ddbec448d8cbcd515bfba86c6/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:14.996720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:15.034414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf0915-d388-4ded-9acf-cfe20766b8a5 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.045358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.046031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.046315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.046739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.047427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.051198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.054156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7f471-57ee-43d4-ba96-83862a29407b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b983df2cad7649d5809cff0237d79409, user_id=047aad4ddbec448d8cbcd515bfba86c6, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.057695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7f471-57ee-43d4-ba96-83862a29407b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.091559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 876/1739] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:14 2022] PUT /identity/v3/projects/b983df2cad7649d5809cff0237d79409/users/047aad4ddbec448d8cbcd515bfba86c6/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:15.103183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783530f3-0d72-4852-b239-5caacb21493f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.104448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783530f3-0d72-4852-b239-5caacb21493f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.105071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783530f3-0d72-4852-b239-5caacb21493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.123424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 864/1740] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:14 2022] POST /identity/v3/users => generated 279 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:15.126728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.143475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829ea6d-6d14-47d3-bfed-dc1172212a01 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.164470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-783530f3-0d72-4852-b239-5caacb21493f None None] MFA Rules not processed for user `047aad4ddbec448d8cbcd515bfba86c6`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:15.165902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-783530f3-0d72-4852-b239-5caacb21493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:15.280593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.281317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.281671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.282606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.283433 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.286540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.302044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 865/1741] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:15.305949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.324977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35341-b196-45dd-a223-a705ebc7ff21 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.327420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 877/1742] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:15.331271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.332118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783530f3-0d72-4852-b239-5caacb21493f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.332268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.332884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.333437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.334341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.337716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.353334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783530f3-0d72-4852-b239-5caacb21493f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.361051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 866/1743] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:15.362430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.364623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.365284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.365573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.365848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.366531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.368491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.375851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3146-8882-4f45-b6d8-c04cee648b17 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.381824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5058-bf85-4450-aeb7-f58d3c951709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.382736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5058-bf85-4450-aeb7-f58d3c951709 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.383419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5058-bf85-4450-aeb7-f58d3c951709 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.383736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5058-bf85-4450-aeb7-f58d3c951709 admin admin] PATH_INFO: `/v3/projects/dbfa9f32d3524556a7c3fb5701be6b13/users/0675be3c7f2d49b99d7040e6a2f15b56/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.409551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5058-bf85-4450-aeb7-f58d3c951709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfa9f32d3524556a7c3fb5701be6b13, user_id=0675be3c7f2d49b99d7040e6a2f15b56, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.413532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5058-bf85-4450-aeb7-f58d3c951709 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.443988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 867/1744] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:15 2022] PUT /identity/v3/projects/dbfa9f32d3524556a7c3fb5701be6b13/users/0675be3c7f2d49b99d7040e6a2f15b56/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:15.445945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea988a-1564-4c88-9b09-140c7287cac1 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.446345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea988a-1564-4c88-9b09-140c7287cac1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.446629 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea988a-1564-4c88-9b09-140c7287cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.463414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 878/1745] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:15 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:15.467745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.486954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b9ea988a-1564-4c88-9b09-140c7287cac1 None None] MFA Rules not processed for user `0675be3c7f2d49b99d7040e6a2f15b56`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:15.488221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b9ea988a-1564-4c88-9b09-140c7287cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:15.579864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:15.584182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 868/1746] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:15 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:15.587273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea988a-1564-4c88-9b09-140c7287cac1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.592283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f0d5-b8d0-45cc-a5f5-395dfc0e80ec admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.598743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.599980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea988a-1564-4c88-9b09-140c7287cac1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.600121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.600709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.601226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.602118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.604832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.605451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.606157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.606507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.607001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.608002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.610111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.641501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 879/1747] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:15 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:15.648043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.668072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4c27-ff88-47b0-8427-eb8c406cf31e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.675814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.677446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.677579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:15.678149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.678604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.679484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.692624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.708561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 869/1748] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:15 2022] POST /identity/v3/projects => generated 357 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:15.708561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.716843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:15.722883 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 880/1749] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:15.724696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.755306 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcbd5f-4b90-4f43-9a62-d4518dc7bee8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.879018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.880139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.880483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.880836 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.881621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:15.884248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:15.902543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b20aa9-3657-4550-886d-e9c0549ff6de admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:15.913722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:15.914576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:15.914885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:15.915162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:15.922432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:15.940888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 881/1750] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:15 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:15.941997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:15.943735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:16.027407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.027407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.041628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 870/1751] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:16.048585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.064326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7d69d-8f33-4a9b-ad9f-72fb88ddbd4c service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.069565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.070378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.071994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.072379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] PATH_INFO: `/v3/projects/d0b91377c9e44876a63c050d2ea5088c/users/c9008a37407d47c6aef7e5a7a022c030/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.076633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a2f1-b9ad-489e-91cd-4b7e8d822bf0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.086520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.087448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.087895 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.088504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.092065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:16.095899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b91377c9e44876a63c050d2ea5088c, user_id=c9008a37407d47c6aef7e5a7a022c030, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.098725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.108095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.110201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.131718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 871/1752] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:16 2022] PUT /identity/v3/projects/d0b91377c9e44876a63c050d2ea5088c/users/c9008a37407d47c6aef7e5a7a022c030/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:16.132664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.134701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:16.136475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 882/1753] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:16.137455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.160950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9fb29-ad9a-44fa-a045-6dc11b9e29fd service placement] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.283197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:16.288601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b609438-68a9-47e6-a90a-2735346c37e7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.303297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.303987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.304270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.305725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.306437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.306717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.306991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.307876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.311573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.313663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.341743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:16.346496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 883/1754] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:16.347952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.353189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:16.435766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.439460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.465920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 872/1755] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:16.468819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.479126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68291-e7e2-4292-96fd-427ed8a07956 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.484935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.485862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.486220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.486569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.496327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.498893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.506793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059a391-995c-4de4-9f65-8cfe31c92e5e service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.512050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 884/1756] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:16.513203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.522274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.523259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.523470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.523803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.527010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.528355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60ec5d-3abf-4bbf-9985-5bb58bf0258e service placement] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.531574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.536005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.537480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.538096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.538606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] PATH_INFO: `/v3/projects/31e6cc9e52824aa28850633878dbfd78/users/f08b9e99027647459c3ef6e59afcf31b/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.561246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 873/1757] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:16.566174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.578063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e6cc9e52824aa28850633878dbfd78, user_id=f08b9e99027647459c3ef6e59afcf31b, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.586263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.591222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970589b-d5ca-43ec-8790-e2ccd8e7ae60 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:16.600152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629de5ef-19b0-483b-ba31-729559ee6263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:16.601668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629de5ef-19b0-483b-ba31-729559ee6263 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.602041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629de5ef-19b0-483b-ba31-729559ee6263 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.602856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629de5ef-19b0-483b-ba31-729559ee6263 admin admin] PATH_INFO: `/v3/projects/d0b91377c9e44876a63c050d2ea5088c/users/c9008a37407d47c6aef7e5a7a022c030/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.613275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629de5ef-19b0-483b-ba31-729559ee6263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b91377c9e44876a63c050d2ea5088c, user_id=c9008a37407d47c6aef7e5a7a022c030, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:16.617223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 885/1758] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:16 2022] PUT /identity/v3/projects/31e6cc9e52824aa28850633878dbfd78/users/f08b9e99027647459c3ef6e59afcf31b/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:16.620380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629de5ef-19b0-483b-ba31-729559ee6263 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:16.621556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:16.654672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 874/1759] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:16 2022] PUT /identity/v3/projects/d0b91377c9e44876a63c050d2ea5088c/users/c9008a37407d47c6aef7e5a7a022c030/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:16.671754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:16.671754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:16.671754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:16.787456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] MFA Rules not processed for user `c9008a37407d47c6aef7e5a7a022c030`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:16.797792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:16.839334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd848d-1849-4d90-bd4e-390824a0621f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:17.054283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:17.056483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:17.056887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:17.057487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:17.059586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:17.063603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:17.069097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:17.096757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 886/1760] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:17.106548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:17.120854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0d5a5-f63d-47b8-bef9-d667c8a23c3d admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:17.126602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1b552-520a-4e3f-9230-f736661e55e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:17.127391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1b552-520a-4e3f-9230-f736661e55e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:17.127901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1b552-520a-4e3f-9230-f736661e55e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:17.128352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1b552-520a-4e3f-9230-f736661e55e5 admin admin] PATH_INFO: `/v3/projects/31e6cc9e52824aa28850633878dbfd78/users/f08b9e99027647459c3ef6e59afcf31b/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:17.131160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1b552-520a-4e3f-9230-f736661e55e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e6cc9e52824aa28850633878dbfd78, user_id=f08b9e99027647459c3ef6e59afcf31b, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:17.134030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1b552-520a-4e3f-9230-f736661e55e5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:17.150731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 887/1761] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:17 2022] PUT /identity/v3/projects/31e6cc9e52824aa28850633878dbfd78/users/f08b9e99027647459c3ef6e59afcf31b/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:17.162599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:17.163795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:17.167989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:17.168142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 875/1762] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:17.178979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:17.182656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:17.255186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] MFA Rules not processed for user `f08b9e99027647459c3ef6e59afcf31b`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:17.256462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:17.362743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b422-f002-484b-8704-8e054909a2c4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:17.404165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 888/1763] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:17.472698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:17.526526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c8f7-185b-468a-99b6-cb06df625a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:17.527456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c8f7-185b-468a-99b6-cb06df625a2f service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:17.527872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c8f7-185b-468a-99b6-cb06df625a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:17.528299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c8f7-185b-468a-99b6-cb06df625a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:17.696702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c8f7-185b-468a-99b6-cb06df625a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:17.698274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c8f7-185b-468a-99b6-cb06df625a2f service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:17.720732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:17.722851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:17.733847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 876/1764] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:17.779060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53676e83-2c62-40ee-b687-fb94ec4f00d1 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:17.795272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:17.795272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:17.795272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:17.802566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:17.847848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:17.856486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:17.897658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175c702-96b4-46fe-8a15-0866cad9f586 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:17.898157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175c702-96b4-46fe-8a15-0866cad9f586 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:17.898575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175c702-96b4-46fe-8a15-0866cad9f586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:17.908989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 889/1765] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:17 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:17.956941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6175c702-96b4-46fe-8a15-0866cad9f586 None None] MFA Rules not processed for user `ec303a823f554fae8e5faf6f1e3df154`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:17.958244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6175c702-96b4-46fe-8a15-0866cad9f586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:18.146837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 877/1766] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:18.541676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:18.544137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:18.706217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175c702-96b4-46fe-8a15-0866cad9f586 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:18.723096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175c702-96b4-46fe-8a15-0866cad9f586 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:18.745721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:18.746682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:18.749528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:18.751027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:18.829971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eec52-08a5-49e4-b9bb-3e428c046747 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:18.844980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:18.855351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:18.856299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:18.857809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] PATH_INFO: `/v3/users/ac05d284ca5143b19b91648bbde80a84` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:18.863605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac05d284ca5143b19b91648bbde80a84)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:18.872442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:19.053208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:19.058676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:19.092022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac05d284ca5143b19b91648bbde80a84'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.097066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 878/1767] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:19.101544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:19.109407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:19.133437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:19.159457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac05d284ca5143b19b91648bbde80a84'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.162653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac05d284ca5143b19b91648bbde80a84'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.189986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7ce5-03d0-497f-9f0f-e6cd51efdc57 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:19.202368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac05d284ca5143b19b91648bbde80a84'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.236314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:19.238568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:19.241552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:19.243044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] PATH_INFO: `/v3/users/6ab4cc22f1f64edfb6b9b53fa37961a5` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:19.255074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab4cc22f1f64edfb6b9b53fa37961a5)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:19.256869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a49b82ea-977b-4c66-9bc2-54b26fcad4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac05d284ca5143b19b91648bbde80a84'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.278708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:19.324801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 890/1768] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:18 2022] DELETE /identity/v3/users/ac05d284ca5143b19b91648bbde80a84 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:19.338060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:19.340701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:19.341202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:19.421021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:19.449855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:19.454577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:19.562950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab4cc22f1f64edfb6b9b53fa37961a5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.662815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab4cc22f1f64edfb6b9b53fa37961a5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.684882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab4cc22f1f64edfb6b9b53fa37961a5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.688160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab4cc22f1f64edfb6b9b53fa37961a5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.717378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-492c22d1-89e0-44a9-9f24-b8e1362df3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab4cc22f1f64edfb6b9b53fa37961a5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:19.732571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 879/1769] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:19 2022] DELETE /identity/v3/users/6ab4cc22f1f64edfb6b9b53fa37961a5 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:19.749586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d02d-c0fa-46ec-bfb2-be1b5d1940dd None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:19.749885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d02d-c0fa-46ec-bfb2-be1b5d1940dd None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:19.750177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d02d-c0fa-46ec-bfb2-be1b5d1940dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:19.791092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 891/1770] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:19.826226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6200d02d-c0fa-46ec-bfb2-be1b5d1940dd None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:19.827883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6200d02d-c0fa-46ec-bfb2-be1b5d1940dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:19.828817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:19.830722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:20.117280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 880/1771] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:20.168176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fe036-8bf6-41b5-a92b-5c324bc7aa3b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:20.175206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d02d-c0fa-46ec-bfb2-be1b5d1940dd None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:20.377159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d02d-c0fa-46ec-bfb2-be1b5d1940dd None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:20.407121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:20.417487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:20.417873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:20.418163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:20.448489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ebbb-5467-432a-9d17-18fd8bf85852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:20.449070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ebbb-5467-432a-9d17-18fd8bf85852 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:20.455872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ebbb-5467-432a-9d17-18fd8bf85852 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:20.456243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ebbb-5467-432a-9d17-18fd8bf85852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:20.494954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:20.496691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:20.500563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ebbb-5467-432a-9d17-18fd8bf85852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:20.502096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ebbb-5467-432a-9d17-18fd8bf85852 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:20.544410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 892/1772] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:20.556059 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 881/1773] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:21.036736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:21.038488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:21.038488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:21.248719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:21.249997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:21.276707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:21.457058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:21.459210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:21.528132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 893/1774] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:33:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 06:33:21.637112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:21.686076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177ffe1-7cc1-45af-8c23-b39dd60047b7 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:21.706103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba850b36-7e7b-4da5-894d-7979a981d91c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:21.711930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850b36-7e7b-4da5-894d-7979a981d91c service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:21.719183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850b36-7e7b-4da5-894d-7979a981d91c service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:21.719879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850b36-7e7b-4da5-894d-7979a981d91c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:21.733632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ba850b36-7e7b-4da5-894d-7979a981d91c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:21.886165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:21.888053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:21.955932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba850b36-7e7b-4da5-894d-7979a981d91c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:21.957607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba850b36-7e7b-4da5-894d-7979a981d91c service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:22.010845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 882/1775] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:22.181808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85be63-89b5-40ba-8dce-587f01cbcf2b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:22.216657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:22.219763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:22.220292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:22.220766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:22.246379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:22.252244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:22.285979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 894/1776] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:33:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:33:23.610988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14220e-e649-40b2-a943-7e14075cdb31 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:23.611865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14220e-e649-40b2-a943-7e14075cdb31 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:23.611865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14220e-e649-40b2-a943-7e14075cdb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:23.662264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4a14220e-e649-40b2-a943-7e14075cdb31 None None] MFA Rules not processed for user `f25041ca39b84b0b9a3b742d0e43e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:23.664199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4a14220e-e649-40b2-a943-7e14075cdb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:23.836834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 883/1777] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:24.071216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:24.073066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:24.120929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69017623-d267-4307-a65a-927458c04ec5 service swift] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:24.140462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:24.141486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:24.141912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:24.142399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] PATH_INFO: `/v3/projects/cdf06133defe40af8121988c4bc1c0d8` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:24.144640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf06133defe40af8121988c4bc1c0d8)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:24.147901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:24.278879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf06133defe40af8121988c4bc1c0d8', 'request_id': 'req-845c11ea-3c27-41c7-9384-0a088a71ce1a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:24.326892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf06133defe40af8121988c4bc1c0d8', 'request_id': 'req-845c11ea-3c27-41c7-9384-0a088a71ce1a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:24.356023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf06133defe40af8121988c4bc1c0d8', 'request_id': 'req-845c11ea-3c27-41c7-9384-0a088a71ce1a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:24.419433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:24.428238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] The token cache is being invalidate because project cdf06133defe40af8121988c4bc1c0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:24.428581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:24.447269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-845c11ea-3c27-41c7-9384-0a088a71ce1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:24.457558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 895/1778] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:24 2022] DELETE /identity/v3/projects/cdf06133defe40af8121988c4bc1c0d8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:24.458993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4859f-03bc-46ec-b16a-fbb2fe1849d5 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:24.461006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4859f-03bc-46ec-b16a-fbb2fe1849d5 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:24.461006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4859f-03bc-46ec-b16a-fbb2fe1849d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:24.550690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-9bb4859f-03bc-46ec-b16a-fbb2fe1849d5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:24.552033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9bb4859f-03bc-46ec-b16a-fbb2fe1849d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:24.800037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 884/1779] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:24.803199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c64f7-474d-47dc-9b01-8d491320929e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:24.803526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c64f7-474d-47dc-9b01-8d491320929e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:24.803849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c64f7-474d-47dc-9b01-8d491320929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:24.849084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-767c64f7-474d-47dc-9b01-8d491320929e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:24.850361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-767c64f7-474d-47dc-9b01-8d491320929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:24.893439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4859f-03bc-46ec-b16a-fbb2fe1849d5 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:24.894086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 896/1780] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:24.908896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4859f-03bc-46ec-b16a-fbb2fe1849d5 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:24.927022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:24.927941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:24.928288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:24.928611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:24.929343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:24.929718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:24.941368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:24.972549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 885/1781] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:24.977145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c64f7-474d-47dc-9b01-8d491320929e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:24.990291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c64f7-474d-47dc-9b01-8d491320929e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:25.010519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:25.011184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:25.011468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:25.011804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:25.012510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:25.035926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:25.183223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 897/1782] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:24 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:25.187916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:25.225938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc58121-67f3-4841-835e-7336959cd0e5 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:25.355396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:25.600645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:25.601394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:25.601698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:25.602159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:25.604139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:25.609289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:25.660287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 886/1783] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:25 2022] POST /identity/v3/users => generated 287 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:25.664666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:25.690065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e56c-b7ad-4105-bd77-62cd92af61ef admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:25.711906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:25.714734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:25.717591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:25.718181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:25.719475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:25.722620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:25.759593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 898/1784] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:25.760258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:25.775657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bac824-2b44-4b60-870f-e3ca36c263b0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:25.791739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea1dbd-8e23-4e66-a9b5-e87a579e2058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:25.795518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1dbd-8e23-4e66-a9b5-e87a579e2058 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:25.806652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1dbd-8e23-4e66-a9b5-e87a579e2058 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:25.808315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1dbd-8e23-4e66-a9b5-e87a579e2058 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:25.810964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea1dbd-8e23-4e66-a9b5-e87a579e2058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:25.814328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea1dbd-8e23-4e66-a9b5-e87a579e2058 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:25.858705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 887/1785] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:33:25.863599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:25.890208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77365e-ac81-4b66-b620-7b7e2feb3b71 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:25.908052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0e507-154a-48f8-b51b-8744640be346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:25.909917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e507-154a-48f8-b51b-8744640be346 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:25.914220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e507-154a-48f8-b51b-8744640be346 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:25.914702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e507-154a-48f8-b51b-8744640be346 admin admin] PATH_INFO: `/v3/projects/cc762eb3338a4e0dad63409f73fab455/users/74e08e8425014743a0ca316d3f49a91f/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:26.001083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e507-154a-48f8-b51b-8744640be346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc762eb3338a4e0dad63409f73fab455, user_id=74e08e8425014743a0ca316d3f49a91f, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:26.013736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e507-154a-48f8-b51b-8744640be346 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:26.076127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 899/1786] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:25 2022] PUT /identity/v3/projects/cc762eb3338a4e0dad63409f73fab455/users/74e08e8425014743a0ca316d3f49a91f/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:26.076240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:26.076240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:26.076240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:26.114599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:26.115323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:26.116329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:26.158147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] MFA Rules not processed for user `c206251915e74dba98b9422cf2f026d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:26.161624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:26.189317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] MFA Rules not processed for user `74e08e8425014743a0ca316d3f49a91f`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:26.190567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:26.433829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 900/1787] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jul 28 06:33:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:26.483766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 888/1788] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:26.588412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:26.592749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:26.719800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:26.721872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:26.793224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6f2dc-b921-4e2f-a933-6091e6afe267 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:26.805632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:26.806568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:26.808471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:26.809114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:26.845931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:26.852172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:26.878428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 889/1789] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:26.882970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:26.885843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daae73e-2a13-4a39-a49c-7fcfeb7bfad6 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:26.908354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e716-3994-4e22-9309-dbd58c95725a service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:26.914088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:26.916134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:26.916313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:26.916543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:26.916680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:26.917361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:26.917756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:26.918175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:26.955550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:26.960486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:26.996098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:26.998992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 890/1790] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:27.002742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:27.003418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:27.006762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:27.068634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 901/1791] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:27.198177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bbdd3-b024-45cb-9290-828e86ec120e service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:27.230639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:27.231288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:27.232076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:27.235124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] PATH_INFO: `/v3/projects/bba8bea0396044baa2fc397e13d2831b` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:27.242434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba8bea0396044baa2fc397e13d2831b)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:27.245535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:27.275031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:27.407097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba8bea0396044baa2fc397e13d2831b', 'request_id': 'req-19797ca5-7916-4af9-9e28-5d1224098f4d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.420887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba8bea0396044baa2fc397e13d2831b', 'request_id': 'req-19797ca5-7916-4af9-9e28-5d1224098f4d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.436191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba8bea0396044baa2fc397e13d2831b', 'request_id': 'req-19797ca5-7916-4af9-9e28-5d1224098f4d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.471222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] The token cache is being invalidate because project bba8bea0396044baa2fc397e13d2831b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:27.471745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.472910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.477264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 891/1792] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:26 2022] DELETE /identity/v3/projects/bba8bea0396044baa2fc397e13d2831b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:27.482142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:27.515085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adc89f-2326-42d8-bdc0-d7c85a7e7fc5 service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:27.673580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:27.767869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:27.768815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:27.772697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:27.772697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] PATH_INFO: `/v3/users/86ec80dd4ec24520b0c5d62f810b7aab` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:27.776908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ec80dd4ec24520b0c5d62f810b7aab)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:27.779415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:27.930142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ec80dd4ec24520b0c5d62f810b7aab'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.978271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ec80dd4ec24520b0c5d62f810b7aab'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.978812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ec80dd4ec24520b0c5d62f810b7aab'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:27.993411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ec80dd4ec24520b0c5d62f810b7aab'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:28.006347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5a3bf849-e1c6-4c94-bc31-8db417f95119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ec80dd4ec24520b0c5d62f810b7aab'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:28.020703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 902/1793] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:27 2022] DELETE /identity/v3/users/86ec80dd4ec24520b0c5d62f810b7aab => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:28.652520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:28.653980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:28.680227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797ca5-7916-4af9-9e28-5d1224098f4d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:28.849675 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:28.851012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:28.851451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:28.852116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] PATH_INFO: `/v3/users/74e08e8425014743a0ca316d3f49a91f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:28.854187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e08e8425014743a0ca316d3f49a91f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:28.857404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:28.996225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e08e8425014743a0ca316d3f49a91f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:29.025574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e08e8425014743a0ca316d3f49a91f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:29.059326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e08e8425014743a0ca316d3f49a91f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:29.063002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e08e8425014743a0ca316d3f49a91f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:29.098621 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e08e8425014743a0ca316d3f49a91f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:29.116569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 892/1794] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:28 2022] DELETE /identity/v3/users/74e08e8425014743a0ca316d3f49a91f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:29.121155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002183-d41f-4d34-9c7b-765f5b81cb79 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:29.121717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002183-d41f-4d34-9c7b-765f5b81cb79 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:29.121717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002183-d41f-4d34-9c7b-765f5b81cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:29.168066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6d002183-d41f-4d34-9c7b-765f5b81cb79 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:29.169822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6d002183-d41f-4d34-9c7b-765f5b81cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:29.338666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 903/1795] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:29.474154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:29.476512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:29.523764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:29.743705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6843-5718-460e-87e0-432a269d15eb admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:29.756462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed63f-b6ad-446a-9e4d-0811f1676aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:29.759408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed63f-b6ad-446a-9e4d-0811f1676aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:29.761263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed63f-b6ad-446a-9e4d-0811f1676aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:29.761726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed63f-b6ad-446a-9e4d-0811f1676aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:29.798504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed63f-b6ad-446a-9e4d-0811f1676aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:29.809863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed63f-b6ad-446a-9e4d-0811f1676aa5 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:29.841137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 893/1796] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:32.673502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517f1f1-4e98-4ad0-8101-4642cbb242b5 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:32.674067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517f1f1-4e98-4ad0-8101-4642cbb242b5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:32.674067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517f1f1-4e98-4ad0-8101-4642cbb242b5 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:32.675763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 904/1797] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:33:32.684270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417480-c8ee-4049-9188-2b41bcee4915 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:32.685991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417480-c8ee-4049-9188-2b41bcee4915 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:32.686416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417480-c8ee-4049-9188-2b41bcee4915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:32.785178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7d417480-c8ee-4049-9188-2b41bcee4915 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:32.786490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7d417480-c8ee-4049-9188-2b41bcee4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:32.809355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517f1f1-4e98-4ad0-8101-4642cbb242b5 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:32.811110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5517f1f1-4e98-4ad0-8101-4642cbb242b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:32.863481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517f1f1-4e98-4ad0-8101-4642cbb242b5 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:32.883936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:32.886665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:32.889974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:32.892361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] PATH_INFO: `/v3/projects/cc762eb3338a4e0dad63409f73fab455` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:32.900515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc762eb3338a4e0dad63409f73fab455)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:32.910267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:33.104676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 894/1798] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:33:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:33.112313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592254c-7168-46c0-b070-c30d2d15736a None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:33.112945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592254c-7168-46c0-b070-c30d2d15736a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:33.114268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592254c-7168-46c0-b070-c30d2d15736a None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:33.127523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 895/1799] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:33:33 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:33:33.142689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:33.151794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc762eb3338a4e0dad63409f73fab455', 'request_id': 'req-e522068e-54c2-4703-87ad-c6f302c4bb88'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:33.180990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc762eb3338a4e0dad63409f73fab455', 'request_id': 'req-e522068e-54c2-4703-87ad-c6f302c4bb88'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:33.199084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140536-ac46-4b07-b015-d4e9e5c69111 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:33.199662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140536-ac46-4b07-b015-d4e9e5c69111 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:33.200226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140536-ac46-4b07-b015-d4e9e5c69111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:33.216452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc762eb3338a4e0dad63409f73fab455', 'request_id': 'req-e522068e-54c2-4703-87ad-c6f302c4bb88'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:33.238940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6c140536-ac46-4b07-b015-d4e9e5c69111 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:33.242110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6c140536-ac46-4b07-b015-d4e9e5c69111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:33.249227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] The token cache is being invalidate because project cc762eb3338a4e0dad63409f73fab455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:33.249449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:33.252432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e522068e-54c2-4703-87ad-c6f302c4bb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:33.254692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 905/1800] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:32 2022] DELETE /identity/v3/projects/cc762eb3338a4e0dad63409f73fab455 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:33.259867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17624-aef4-4a86-b213-7dc673aec944 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:33.260361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17624-aef4-4a86-b213-7dc673aec944 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:33.260782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17624-aef4-4a86-b213-7dc673aec944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:33.297373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-8ec17624-aef4-4a86-b213-7dc673aec944 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:33.299428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8ec17624-aef4-4a86-b213-7dc673aec944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:33.437534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 896/1801] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:33:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:33.458498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 906/1802] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:33.467667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed140-007d-4cf0-be83-62eb2989980e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:33.467946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed140-007d-4cf0-be83-62eb2989980e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:33.469030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed140-007d-4cf0-be83-62eb2989980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:33.520760 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e72ed140-007d-4cf0-be83-62eb2989980e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:33.523109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e72ed140-007d-4cf0-be83-62eb2989980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:33.550184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 897/1803] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:33.554849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17624-aef4-4a86-b213-7dc673aec944 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:33.573033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17624-aef4-4a86-b213-7dc673aec944 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:33.583042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:33.591506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:33.591506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:33.591506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:33.591506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:33.591506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:33.594048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:33.624661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 907/1804] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:33.629186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed140-007d-4cf0-be83-62eb2989980e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:33.642889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed140-007d-4cf0-be83-62eb2989980e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:33.656696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:33.657764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:33.664426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:33.665471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:33.668186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:33.673125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:33.791038 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 898/1805] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:33 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:33.795483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:33.807214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf0a5-5aba-47e9-83a4-fcf0557c1b92 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:33.840858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:33.842556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:33.879286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:33.945648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:33.946351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:33.946637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:33.946974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:33.947610 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:33.956659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:33.999532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 908/1806] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:33 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:34.002408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:34.027930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe430c9b-5f87-463a-8c02-87702db6895f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:34.045287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:34.046332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:34.046721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:34.047263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09790-8a27-42e7-b064-3a98ab875175 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:34.048544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:34.049391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:34.054512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:34.055244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:34.055606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:34.055915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] PATH_INFO: `/v3/projects/b723f1439ec340b3a60098f0af284991` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:34.056359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:34.057562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b723f1439ec340b3a60098f0af284991)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:34.072686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:34.101165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 909/1807] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:34.106941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:34.127766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe542-f120-4aa7-b0fa-24fde23a7fe1 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:34.145898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:34.146708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:34.146952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:34.147230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:34.147970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:34.156263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:34.178198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 910/1808] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:34.182595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:34.188265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b723f1439ec340b3a60098f0af284991', 'request_id': 'req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.211409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b723f1439ec340b3a60098f0af284991', 'request_id': 'req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.227179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b2167-1f42-43cd-a3b0-b46176039807 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:34.228562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b723f1439ec340b3a60098f0af284991', 'request_id': 'req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.251426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] The token cache is being invalidate because project b723f1439ec340b3a60098f0af284991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:34.251830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.252688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.257289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 899/1809] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:33 2022] DELETE /identity/v3/projects/b723f1439ec340b3a60098f0af284991 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:34.258602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:34.260511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:34.317322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:34.426531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:34.427314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:34.427860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:34.428211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] PATH_INFO: `/v3/projects/b81e8e1625e24b85a8b7eabe5f156336/users/66f0385ce39d448881b78c8fa38f0dde/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:34.463292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2edce-dabd-41d3-91cf-c688f63eb8f7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:34.481704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81e8e1625e24b85a8b7eabe5f156336, user_id=66f0385ce39d448881b78c8fa38f0dde, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:34.487547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:34.489612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:34.495034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:34.496304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:34.496686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] PATH_INFO: `/v3/users/1a9486ac45184d63b29177d983f5d81c` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:34.501055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9486ac45184d63b29177d983f5d81c)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:34.505642 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:34.555694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 911/1810] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:34 2022] PUT /identity/v3/projects/b81e8e1625e24b85a8b7eabe5f156336/users/66f0385ce39d448881b78c8fa38f0dde/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:34.555694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:34.555694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:34.674735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:34.681547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9486ac45184d63b29177d983f5d81c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.700012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9486ac45184d63b29177d983f5d81c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.710354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9486ac45184d63b29177d983f5d81c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.711632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9486ac45184d63b29177d983f5d81c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.723690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-61871e7f-fcb6-47bb-bc19-980630779164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9486ac45184d63b29177d983f5d81c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:34.732606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 900/1811] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:34 2022] DELETE /identity/v3/users/1a9486ac45184d63b29177d983f5d81c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:34.733926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:34.734406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:34.734751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:34.741421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7d4a9-fb2c-4481-8643-aaf1d33c9083 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:34.784662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] MFA Rules not processed for user `66f0385ce39d448881b78c8fa38f0dde`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:34.786449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:34.945618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:34.946278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 901/1812] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:34.948765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:34.949657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:34.950095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:34.952345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:34.953398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:34.958297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:34.974635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:34.981052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.025429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 912/1813] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:35.065093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:35.067363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:35.097304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2b29-9eb7-46f7-80fa-ef641b8cf3d5 service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:35.110503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:35.111868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.112360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.112823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.135195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0267ea-dfef-47a0-8804-9f2bada5701c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:35.135751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:35.145651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:35.147819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.148241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.148523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.149371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:35.152164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.166199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:35.168776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.184903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 913/1814] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:35.239291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 902/1815] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:34 2022] POST /identity/v3/projects => generated 363 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:35.243426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:35.266075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bc762-b403-4564-90ec-fed1c75b4477 service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:35.311834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:35.375330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:35.376017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.376710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.376710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.377439 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:35.381340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.432048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 914/1816] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:35 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:35.434935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:35.449457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99ce9d-2123-4c04-91d1-79f3404a4eda admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:35.457383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:35.458037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.458331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.458824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.459761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:35.461902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.480921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 903/1817] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:35.485116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:35.497412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfb84-3b56-4e7f-beb1-4799f5e05081 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:35.503550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:35.504349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.504627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.504900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] PATH_INFO: `/v3/projects/b9691a2bc58b49a0b237084b9f3ff5bd/users/5b7b9de60d874836975cb0ebb1d20e11/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.520873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9691a2bc58b49a0b237084b9f3ff5bd, user_id=5b7b9de60d874836975cb0ebb1d20e11, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:35.523371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.549108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 915/1818] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:35 2022] PUT /identity/v3/projects/b9691a2bc58b49a0b237084b9f3ff5bd/users/5b7b9de60d874836975cb0ebb1d20e11/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:35.553213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:35.567782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86422-47d5-418b-899a-8326fd238e9c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:35.604027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:35.661351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734352be-ed69-4899-b69e-9e4a21e20f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:35.661988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734352be-ed69-4899-b69e-9e4a21e20f58 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.662268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734352be-ed69-4899-b69e-9e4a21e20f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.662540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734352be-ed69-4899-b69e-9e4a21e20f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.663237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734352be-ed69-4899-b69e-9e4a21e20f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:35.665116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734352be-ed69-4899-b69e-9e4a21e20f58 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.679682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 904/1819] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:33:35.683437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:35.703549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743951c-e8fb-487b-a969-1841854ac49f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:35.712031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:35.713119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.713891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.715110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] PATH_INFO: `/v3/projects/b9691a2bc58b49a0b237084b9f3ff5bd/users/5b7b9de60d874836975cb0ebb1d20e11/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.718205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9691a2bc58b49a0b237084b9f3ff5bd, user_id=5b7b9de60d874836975cb0ebb1d20e11, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:35.721348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:35.747015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 916/1820] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:35 2022] PUT /identity/v3/projects/b9691a2bc58b49a0b237084b9f3ff5bd/users/5b7b9de60d874836975cb0ebb1d20e11/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:35.749355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c7c3-e409-4417-981b-95913037292a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:35.749599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c7c3-e409-4417-981b-95913037292a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:35.749987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c7c3-e409-4417-981b-95913037292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:35.785941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-33f8c7c3-e409-4417-981b-95913037292a None None] MFA Rules not processed for user `5b7b9de60d874836975cb0ebb1d20e11`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:35.787836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-33f8c7c3-e409-4417-981b-95913037292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:35.943293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:35.945651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:35.972415 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 905/1821] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:35.999735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8c7c3-e409-4417-981b-95913037292a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.001458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-33f8c7c3-e409-4417-981b-95913037292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:36.091076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f026e-d6ab-425f-b522-75b04650b125 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.091288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8c7c3-e409-4417-981b-95913037292a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.095523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49db6e-d44b-4d7b-9271-b8af89c64469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.096985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49db6e-d44b-4d7b-9271-b8af89c64469 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.097240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.097365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49db6e-d44b-4d7b-9271-b8af89c64469 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.097580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49db6e-d44b-4d7b-9271-b8af89c64469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.097904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.098449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.098833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] PATH_INFO: `/v3/projects/10485ad1a0624bf28ce269c6345e853b` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.100970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10485ad1a0624bf28ce269c6345e853b)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.104034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.112065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49db6e-d44b-4d7b-9271-b8af89c64469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.114067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49db6e-d44b-4d7b-9271-b8af89c64469 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.129406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 906/1822] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:36.205620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10485ad1a0624bf28ce269c6345e853b', 'request_id': 'req-e42250c7-e23d-4003-aacf-6f11c1d935d6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:36.214112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10485ad1a0624bf28ce269c6345e853b', 'request_id': 'req-e42250c7-e23d-4003-aacf-6f11c1d935d6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:36.225097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10485ad1a0624bf28ce269c6345e853b', 'request_id': 'req-e42250c7-e23d-4003-aacf-6f11c1d935d6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:36.242089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] The token cache is being invalidate because project 10485ad1a0624bf28ce269c6345e853b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:36.242454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:36.244031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:36.252353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 917/1823] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:35 2022] DELETE /identity/v3/projects/10485ad1a0624bf28ce269c6345e853b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:36.254083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc246-9644-4b78-85df-9e6f053afbb7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.254396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc246-9644-4b78-85df-9e6f053afbb7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.254648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc246-9644-4b78-85df-9e6f053afbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.268987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.274298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:36.290365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:36.304999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-252dc246-9644-4b78-85df-9e6f053afbb7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:36.306337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-252dc246-9644-4b78-85df-9e6f053afbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:36.409331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:36.425749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42250c7-e23d-4003-aacf-6f11c1d935d6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.429982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.431250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.432153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.432443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.438396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:36.454540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 907/1824] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:36.456408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430aaef-02aa-4feb-bf8f-222122f92efa None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.456697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430aaef-02aa-4feb-bf8f-222122f92efa None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.456966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430aaef-02aa-4feb-bf8f-222122f92efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.498277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6430aaef-02aa-4feb-bf8f-222122f92efa None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:36.500876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6430aaef-02aa-4feb-bf8f-222122f92efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:36.523472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 908/1825] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:36.539508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430aaef-02aa-4feb-bf8f-222122f92efa None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.540123 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430aaef-02aa-4feb-bf8f-222122f92efa None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.540359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.542114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.545026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.545655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.545932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.546259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.546882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:36.547181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.548994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.552549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 918/1826] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:36.564302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 909/1827] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:33:36.568426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.579393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9605e5-7eea-4871-91ec-859ed9c1d95f service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.585859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.586626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.586967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.587312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.588094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.590068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.626991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 919/1828] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:36 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:36.633182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.666457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86556-a08a-4950-8da3-ef6190ae1b6f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.796719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.797502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.797859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.798198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.798970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.801301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.832645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 910/1829] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:36 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:36.834111 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.844746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e895-cab0-4173-aec2-46cf4b11e465 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.850568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.851529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.851944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.852425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.853215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.854904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.866791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 920/1830] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:36.871042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.881553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb18407-2969-4324-bd03-989737bf9a21 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.886364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72257a-9c33-45b7-9f90-cdcc70007105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.887048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72257a-9c33-45b7-9f90-cdcc70007105 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.887395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72257a-9c33-45b7-9f90-cdcc70007105 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.887702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72257a-9c33-45b7-9f90-cdcc70007105 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.888392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72257a-9c33-45b7-9f90-cdcc70007105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.889992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72257a-9c33-45b7-9f90-cdcc70007105 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.901268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 911/1831] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:36.905343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:36.916325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3cfb-c86d-459b-939e-42e70291dcbb admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:36.921238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:36.921923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.922206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.922483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] PATH_INFO: `/v3/projects/cc3d02cfc0634dfcb686980fe60e642b/users/c868bdbe1c9a427a8cbf15fd8d0cccef/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.937681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3d02cfc0634dfcb686980fe60e642b, user_id=c868bdbe1c9a427a8cbf15fd8d0cccef, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:36.940400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:36.956041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 921/1832] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:36 2022] PUT /identity/v3/projects/cc3d02cfc0634dfcb686980fe60e642b/users/c868bdbe1c9a427a8cbf15fd8d0cccef/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:36.968918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ebf2-7c3a-4b2c-b56d-b652a09c8d9f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:36.969202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ebf2-7c3a-4b2c-b56d-b652a09c8d9f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:36.969472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ebf2-7c3a-4b2c-b56d-b652a09c8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:36.997058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5564ebf2-7c3a-4b2c-b56d-b652a09c8d9f None None] MFA Rules not processed for user `c868bdbe1c9a427a8cbf15fd8d0cccef`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:36.998269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5564ebf2-7c3a-4b2c-b56d-b652a09c8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:37.065442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 912/1833] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:37.071135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:37.140385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0099b97-0c3d-4492-958e-5780a549f238 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:37.145159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:37.145859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.146155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.146427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.147118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:37.149214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:37.155078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:37.179034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 922/1834] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:37 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:37.183011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ebf2-7c3a-4b2c-b56d-b652a09c8d9f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:37.195343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ebf2-7c3a-4b2c-b56d-b652a09c8d9f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:37.231488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:37.258372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:37.259012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.259350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.259656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.260328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:37.262269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:37.284316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 913/1835] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:37 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:37.288435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:37.298948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbc51-d27e-49c8-8931-e6a24cb8eca3 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:37.303928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:37.304564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.304825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.305095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.305832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:37.307525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:37.323112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 923/1836] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:37.324409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:37.336820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a0a2-01f3-4f08-810f-c71a83c1240d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:37.341541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90071b7-cee8-4459-b175-15b7f01c39e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:37.342210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90071b7-cee8-4459-b175-15b7f01c39e9 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.342522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90071b7-cee8-4459-b175-15b7f01c39e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.342828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90071b7-cee8-4459-b175-15b7f01c39e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.343532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90071b7-cee8-4459-b175-15b7f01c39e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:37.345211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90071b7-cee8-4459-b175-15b7f01c39e9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:37.362467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 914/1837] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:37.364272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:37.374887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42956d-7c3e-40e3-bce8-a29fcb859997 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:37.380125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:37.380317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.380580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.380850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] PATH_INFO: `/v3/projects/e3b17e44cbcc4b26a1b3c5294469cc22/users/0e0163545d4840dfb1fb4a7d111317d0/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.402616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b17e44cbcc4b26a1b3c5294469cc22, user_id=0e0163545d4840dfb1fb4a7d111317d0, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:37.406000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:37.423510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 924/1838] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:37 2022] PUT /identity/v3/projects/e3b17e44cbcc4b26a1b3c5294469cc22/users/0e0163545d4840dfb1fb4a7d111317d0/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:37.434029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1bcfa-3c47-4efd-83af-74991c9ea023 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.434321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1bcfa-3c47-4efd-83af-74991c9ea023 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.434526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1bcfa-3c47-4efd-83af-74991c9ea023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.464383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-50c1bcfa-3c47-4efd-83af-74991c9ea023 None None] MFA Rules not processed for user `0e0163545d4840dfb1fb4a7d111317d0`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:37.465621 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-50c1bcfa-3c47-4efd-83af-74991c9ea023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:37.547078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 915/1839] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:37.552858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:37.668686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81f5b0-2ebb-4991-8188-06ef0be3d314 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:37.690379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:37.691205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.691586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.692116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.693606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:37.696116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:37.740641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 925/1840] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:37 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:37.741525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1bcfa-3c47-4efd-83af-74991c9ea023 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:37.771987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1bcfa-3c47-4efd-83af-74991c9ea023 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:37.945936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:37.947484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:37.950881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:37.952186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:37.955304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:37.964047 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:38.057178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 916/1841] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:37 2022] POST /identity/v3/users => generated 295 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:38.058939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:38.096768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9455-3b59-4bb6-a3e8-5339dd1617ab admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:38.106388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:38.107284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:38.107704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:38.108075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:38.108875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:38.111184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:38.127290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 926/1842] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:38.131809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:38.166462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419eed9-243b-401c-bd3d-39c3ee27ef36 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:38.175354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:38.176101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:38.176386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:38.176665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] PATH_INFO: `/v3/projects/c41c4810d64e4680bbd358a738134d1e/users/306c61f13d7d479fb73c6372d7068ea7/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:38.224183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41c4810d64e4680bbd358a738134d1e, user_id=306c61f13d7d479fb73c6372d7068ea7, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:38.227462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:38.270883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 917/1843] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:38 2022] PUT /identity/v3/projects/c41c4810d64e4680bbd358a738134d1e/users/306c61f13d7d479fb73c6372d7068ea7/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:38.272625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:38.290897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3f9a-1b13-4988-b895-80b89905d2a9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:38.459912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1f9ea-0da7-45d9-9ee5-9f144ce8bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:38.460570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f9ea-0da7-45d9-9ee5-9f144ce8bb06 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:38.460859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f9ea-0da7-45d9-9ee5-9f144ce8bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:38.461136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f9ea-0da7-45d9-9ee5-9f144ce8bb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:38.461908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1f9ea-0da7-45d9-9ee5-9f144ce8bb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:38.463543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1f9ea-0da7-45d9-9ee5-9f144ce8bb06 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:38.492727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 927/1844] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:38.498885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:38.515351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66b9f3-2448-4ba4-b594-2bca6c32c2ae admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:38.526847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:38.529286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:38.529671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:38.530954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] PATH_INFO: `/v3/projects/c41c4810d64e4680bbd358a738134d1e/users/306c61f13d7d479fb73c6372d7068ea7/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:38.536413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41c4810d64e4680bbd358a738134d1e, user_id=306c61f13d7d479fb73c6372d7068ea7, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:38.542012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:38.554402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:38.579668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 918/1845] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:38 2022] PUT /identity/v3/projects/c41c4810d64e4680bbd358a738134d1e/users/306c61f13d7d479fb73c6372d7068ea7/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:38.588454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67990-45e2-4602-8cd1-edcdcc81d75d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:38.589020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67990-45e2-4602-8cd1-edcdcc81d75d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:38.589020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67990-45e2-4602-8cd1-edcdcc81d75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:38.663729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0de67990-45e2-4602-8cd1-edcdcc81d75d None None] MFA Rules not processed for user `306c61f13d7d479fb73c6372d7068ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:38.665092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0de67990-45e2-4602-8cd1-edcdcc81d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:38.681862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:38.737336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:38.742809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:38.834018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 928/1846] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:38.847776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67990-45e2-4602-8cd1-edcdcc81d75d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:38.859086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97552-b582-4956-9eb7-3ec0ab30ce01 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:38.870689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:38.872894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:38.873544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:38.873820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] PATH_INFO: `/v3/users/047aad4ddbec448d8cbcd515bfba86c6` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:38.875176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=047aad4ddbec448d8cbcd515bfba86c6)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:38.877612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:38.943029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67990-45e2-4602-8cd1-edcdcc81d75d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:38.948666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d16d6e-f093-4676-af02-81a39768b47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:38.949313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d16d6e-f093-4676-af02-81a39768b47a service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:38.949648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d16d6e-f093-4676-af02-81a39768b47a service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:38.949928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d16d6e-f093-4676-af02-81a39768b47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:38.951295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047aad4ddbec448d8cbcd515bfba86c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:38.965560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d16d6e-f093-4676-af02-81a39768b47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:38.967391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d16d6e-f093-4676-af02-81a39768b47a service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:38.981073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047aad4ddbec448d8cbcd515bfba86c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:38.992472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 929/1847] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:38.995999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047aad4ddbec448d8cbcd515bfba86c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:38.997223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047aad4ddbec448d8cbcd515bfba86c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:39.009259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047aad4ddbec448d8cbcd515bfba86c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:39.035449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 919/1848] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:38 2022] DELETE /identity/v3/users/047aad4ddbec448d8cbcd515bfba86c6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:39.037378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:39.040722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:39.041134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:39.052575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:39.055229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:39.075003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:39.077757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:39.185699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a889a-f2db-42b7-840f-202e10af7de1 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:39.193002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:39.194318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:39.194603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:39.194962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:39.197135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:39.210824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 930/1849] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:39.233831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:39.237188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:39.247056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:39.282961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:39.284458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:39.297680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 920/1850] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:39.303245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2262074-3926-4d88-acf6-13ec9d615b49 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:39.306943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:39.307574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:39.307884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:39.308342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:39.315390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:39.319939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:39.321536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:39.332195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 931/1851] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:39.647536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:39.649314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:39.673979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0409-cf44-4145-a05f-6fb9ec542937 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:39.692284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:39.693163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:39.696793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:39.696793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] PATH_INFO: `/v3/projects/b983df2cad7649d5809cff0237d79409` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:39.699526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b983df2cad7649d5809cff0237d79409)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:39.701959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:39.894990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b983df2cad7649d5809cff0237d79409', 'request_id': 'req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:39.903184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b983df2cad7649d5809cff0237d79409', 'request_id': 'req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:39.912490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b983df2cad7649d5809cff0237d79409', 'request_id': 'req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:39.925348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] The token cache is being invalidate because project b983df2cad7649d5809cff0237d79409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:39.925643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:39.926425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:39.931354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 921/1852] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:39 2022] DELETE /identity/v3/projects/b983df2cad7649d5809cff0237d79409 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:39.932631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:39.946460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d22e4-889f-4004-811e-106d1bc499c8 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:40.015541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:40.017915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:40.073841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:40.074519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:40.074802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:40.075083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] PATH_INFO: `/v3/users/c9008a37407d47c6aef7e5a7a022c030` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:40.076915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9008a37407d47c6aef7e5a7a022c030)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:40.079391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:40.164897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9008a37407d47c6aef7e5a7a022c030'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.192962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9008a37407d47c6aef7e5a7a022c030'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.194277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9008a37407d47c6aef7e5a7a022c030'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.218964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9008a37407d47c6aef7e5a7a022c030'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.221226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21d2d1-7a88-458d-b6b1-57412ddbe70f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:40.232001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9008a37407d47c6aef7e5a7a022c030'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.238772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:40.239774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:40.240017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:40.240400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] PATH_INFO: `/v3/users/66f0385ce39d448881b78c8fa38f0dde` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:40.241983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f0385ce39d448881b78c8fa38f0dde)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:40.242091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 932/1853] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:39 2022] DELETE /identity/v3/users/c9008a37407d47c6aef7e5a7a022c030 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:40.244844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:40.267479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:40.270706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:40.358680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f0385ce39d448881b78c8fa38f0dde'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.375848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:40.388298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f0385ce39d448881b78c8fa38f0dde'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.409194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f0385ce39d448881b78c8fa38f0dde'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.410747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f0385ce39d448881b78c8fa38f0dde'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.432087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6764f752-e2ae-4d55-be06-eafb402d7421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f0385ce39d448881b78c8fa38f0dde'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.445845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f1f78-570c-419d-90d1-76424192ab71 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:40.446424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 922/1854] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:40 2022] DELETE /identity/v3/users/66f0385ce39d448881b78c8fa38f0dde => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:40.452627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:40.453365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:40.453956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:40.492660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:40.504175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:40.506883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:40.575580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:40.576623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:40.577200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:40.577556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] PATH_INFO: `/v3/users/0675be3c7f2d49b99d7040e6a2f15b56` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:40.579075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0675be3c7f2d49b99d7040e6a2f15b56)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:40.581385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:40.593992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 923/1855] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:40.631087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:40.632763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:40.661310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0675be3c7f2d49b99d7040e6a2f15b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.705346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0675be3c7f2d49b99d7040e6a2f15b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.707578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0675be3c7f2d49b99d7040e6a2f15b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.741027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0675be3c7f2d49b99d7040e6a2f15b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.752415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4fc38fa3-fbaf-42bb-87ff-7a871b40762f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0675be3c7f2d49b99d7040e6a2f15b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:40.777918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 933/1856] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:40 2022] DELETE /identity/v3/users/0675be3c7f2d49b99d7040e6a2f15b56 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:40.783215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:40.783676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:40.784156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:40.799380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb896-a68f-4eb3-89d1-e1fc63afbcc0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:40.824813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:40.826211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:40.902892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:40.905080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:40.905482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:40.905796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:40.908391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:40.943826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 934/1857] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:40.954568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:40.972710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:40.991730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:40.999447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46d09-3365-42d5-9f19-70bd4de5bdc1 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:41.011013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0a24-533e-4da4-b960-655a86913af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:41.011664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0a24-533e-4da4-b960-655a86913af0 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.011989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0a24-533e-4da4-b960-655a86913af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.012304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0a24-533e-4da4-b960-655a86913af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.053307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:41.054859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:41.056534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b0a24-533e-4da4-b960-655a86913af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:41.060167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b0a24-533e-4da4-b960-655a86913af0 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:41.080309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 924/1858] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:41.080591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 935/1859] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:41.250064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:41.251487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:41.269841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606b99-43bb-4ddf-a54e-f6e558f03a9e service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:41.276923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:41.277665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.278143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.278460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] PATH_INFO: `/v3/projects/d0b91377c9e44876a63c050d2ea5088c` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.279838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b91377c9e44876a63c050d2ea5088c)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:41.281979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:41.362338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b91377c9e44876a63c050d2ea5088c', 'request_id': 'req-81962576-46b9-4757-b499-6c34797f2c88'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:41.371786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b91377c9e44876a63c050d2ea5088c', 'request_id': 'req-81962576-46b9-4757-b499-6c34797f2c88'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:41.384662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b91377c9e44876a63c050d2ea5088c', 'request_id': 'req-81962576-46b9-4757-b499-6c34797f2c88'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:41.407791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] The token cache is being invalidate because project d0b91377c9e44876a63c050d2ea5088c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:41.408107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:41.409053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-81962576-46b9-4757-b499-6c34797f2c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:41.415329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 925/1860] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:41 2022] DELETE /identity/v3/projects/d0b91377c9e44876a63c050d2ea5088c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:41.419340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12fac4-2faa-4005-b98d-38809f1e8c17 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.419340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12fac4-2faa-4005-b98d-38809f1e8c17 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.419340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12fac4-2faa-4005-b98d-38809f1e8c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.453962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5e12fac4-2faa-4005-b98d-38809f1e8c17 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:41.455985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5e12fac4-2faa-4005-b98d-38809f1e8c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:41.493757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:41.569504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 936/1861] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:41.578907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8290901-f7f4-4f09-bd48-446a1dcfff17 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.579704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8290901-f7f4-4f09-bd48-446a1dcfff17 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.579887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8290901-f7f4-4f09-bd48-446a1dcfff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.634298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d8290901-f7f4-4f09-bd48-446a1dcfff17 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:41.637153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d8290901-f7f4-4f09-bd48-446a1dcfff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:41.653193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 926/1862] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:41.660914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12fac4-2faa-4005-b98d-38809f1e8c17 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:41.675129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12fac4-2faa-4005-b98d-38809f1e8c17 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:41.681088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:41.682572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.683045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.683516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.684475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:41.684974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:41.686849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:41.711778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8290901-f7f4-4f09-bd48-446a1dcfff17 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:41.723758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 937/1863] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:41.726755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8290901-f7f4-4f09-bd48-446a1dcfff17 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:41.737971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:41.739414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.740147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.741303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.742382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:41.746378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:41.804046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 927/1864] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:41 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:41.805719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:41.820387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d5ca-fa9e-468e-9d48-de97c6346e24 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:41.901163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:41.901925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.902214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.902549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.903233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:41.905382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:41.947370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 938/1865] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:41 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:41.952924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:41.967805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:41.971042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:41.975150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f9f0-8190-4466-b51d-5e6e053f6e6d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:41.990028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:41.990813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:41.991031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:41.991302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:41.992824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:41.998050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aee59-f01d-49fa-baa9-1225ec30d865 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:41.998614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.012397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:42.014394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.016048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.016356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] PATH_INFO: `/v3/projects/dbfa9f32d3524556a7c3fb5701be6b13` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.022616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 928/1866] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:42.026521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfa9f32d3524556a7c3fb5701be6b13)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:42.029716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.031160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:42.041170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:42.075963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a036c9-47bf-40cd-81ef-58ff6b0811d8 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:42.092260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:42.092991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.093691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.093691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] PATH_INFO: `/v3/projects/b81e8e1625e24b85a8b7eabe5f156336` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.095698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81e8e1625e24b85a8b7eabe5f156336)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:42.097633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.126119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfa9f32d3524556a7c3fb5701be6b13', 'request_id': 'req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.139524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfa9f32d3524556a7c3fb5701be6b13', 'request_id': 'req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.157142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfa9f32d3524556a7c3fb5701be6b13', 'request_id': 'req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.195643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] The token cache is being invalidate because project dbfa9f32d3524556a7c3fb5701be6b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:42.195955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.204124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81e8e1625e24b85a8b7eabe5f156336', 'request_id': 'req-8d978a17-2246-41e0-914f-b6cecf96fba7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.204904 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.210163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 939/1867] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:41 2022] DELETE /identity/v3/projects/dbfa9f32d3524556a7c3fb5701be6b13 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:42.213665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:42.215763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81e8e1625e24b85a8b7eabe5f156336', 'request_id': 'req-8d978a17-2246-41e0-914f-b6cecf96fba7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.218674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:42.228306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81e8e1625e24b85a8b7eabe5f156336', 'request_id': 'req-8d978a17-2246-41e0-914f-b6cecf96fba7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.242996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] The token cache is being invalidate because project b81e8e1625e24b85a8b7eabe5f156336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:42.243736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.245926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.249269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 929/1868] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:42 2022] DELETE /identity/v3/projects/b81e8e1625e24b85a8b7eabe5f156336 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:42.250103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:42.254598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:42.278175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:42.282559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:42.375177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e5c5b-0cb6-4d6f-baa4-5324898519b4 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:42.407931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978a17-2246-41e0-914f-b6cecf96fba7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:42.426509 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:42.427646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.427646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.427821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] PATH_INFO: `/v3/users/f08b9e99027647459c3ef6e59afcf31b` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.429172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08b9e99027647459c3ef6e59afcf31b)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:42.433163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.513096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:42.514668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.515094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.516553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.517612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:42.521112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.540946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08b9e99027647459c3ef6e59afcf31b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.545605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 940/1869] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:42.546510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:42.555149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:42.561469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08b9e99027647459c3ef6e59afcf31b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.572013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08b9e99027647459c3ef6e59afcf31b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.573018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08b9e99027647459c3ef6e59afcf31b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.589133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138bd1-5d44-4503-8ecc-1c1dfcb514c9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:42.593539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08b9e99027647459c3ef6e59afcf31b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.602678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:42.604672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.605547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.605547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] PATH_INFO: `/v3/users/5b7b9de60d874836975cb0ebb1d20e11` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.608486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7b9de60d874836975cb0ebb1d20e11)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:42.612221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 930/1870] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:42 2022] DELETE /identity/v3/users/f08b9e99027647459c3ef6e59afcf31b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:42.613876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:42.615980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.617490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:42.704425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7b9de60d874836975cb0ebb1d20e11'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.747146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7b9de60d874836975cb0ebb1d20e11'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.748655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903d31-dbab-40be-9881-8481bc574e46 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:42.749998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7b9de60d874836975cb0ebb1d20e11'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.762278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:42.763016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.763296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.763571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] PATH_INFO: `/v3/users/c868bdbe1c9a427a8cbf15fd8d0cccef` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.765129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c868bdbe1c9a427a8cbf15fd8d0cccef)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:42.767639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7b9de60d874836975cb0ebb1d20e11'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.772230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.779816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7b9de60d874836975cb0ebb1d20e11'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.791051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 941/1871] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:42 2022] DELETE /identity/v3/users/5b7b9de60d874836975cb0ebb1d20e11 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:42.797501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:42.804003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:42.843707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:42.880830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c868bdbe1c9a427a8cbf15fd8d0cccef'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.892896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:42.906687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c868bdbe1c9a427a8cbf15fd8d0cccef'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.925659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c868bdbe1c9a427a8cbf15fd8d0cccef'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.926241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2c01-5396-4eba-b789-9108382f0dfc admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:42.926780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c868bdbe1c9a427a8cbf15fd8d0cccef'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.932362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734c4e-c971-4990-892d-d7ee6d99d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:42.933083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734c4e-c971-4990-892d-d7ee6d99d35b admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.933522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734c4e-c971-4990-892d-d7ee6d99d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.933808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734c4e-c971-4990-892d-d7ee6d99d35b admin admin] PATH_INFO: `/v3/projects/30f31f8a2de645568726eeb8b7d0e465/users/73d8a329dd5d46bbbb900c3248ee0f03/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.949806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2b54b439-e852-4e60-9363-e6252319e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c868bdbe1c9a427a8cbf15fd8d0cccef'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:42.955501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734c4e-c971-4990-892d-d7ee6d99d35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f31f8a2de645568726eeb8b7d0e465, user_id=73d8a329dd5d46bbbb900c3248ee0f03, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:42.958852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734c4e-c971-4990-892d-d7ee6d99d35b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:42.963000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 931/1872] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:42 2022] DELETE /identity/v3/users/c868bdbe1c9a427a8cbf15fd8d0cccef => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:42.969329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.969727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.970140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.985765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 942/1873] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:42 2022] PUT /identity/v3/projects/30f31f8a2de645568726eeb8b7d0e465/users/73d8a329dd5d46bbbb900c3248ee0f03/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:42.996503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:42.997192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:42.997457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:42.998128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:42.999534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.074998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] MFA Rules not processed for user `73d8a329dd5d46bbbb900c3248ee0f03`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:43.076360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.109201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 932/1874] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:43.124537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.125978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.184180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 943/1875] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:43.185408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.188523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.206509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dcd23-800d-4eb2-9ace-67f955c6bd29 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.212653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.213080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.213614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.213614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] PATH_INFO: `/v3/projects/31e6cc9e52824aa28850633878dbfd78` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.214888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e6cc9e52824aa28850633878dbfd78)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.217300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.234858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25461f-1adf-412c-9f50-f377b6a73e9a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.238821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.239546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.239864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.240139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.251899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.253332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.269958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 933/1876] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:43.270668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.272036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.286384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0aa81-7ce7-4178-aaf2-f2dcadef3e7e service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.304824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e6cc9e52824aa28850633878dbfd78', 'request_id': 'req-17366370-1689-4da2-a04a-e499c8573697'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.329329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e6cc9e52824aa28850633878dbfd78', 'request_id': 'req-17366370-1689-4da2-a04a-e499c8573697'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.343987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e6cc9e52824aa28850633878dbfd78', 'request_id': 'req-17366370-1689-4da2-a04a-e499c8573697'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.372717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] The token cache is being invalidate because project 31e6cc9e52824aa28850633878dbfd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:43.373120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.374664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.384845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 944/1877] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:43 2022] DELETE /identity/v3/projects/31e6cc9e52824aa28850633878dbfd78 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:43.384845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.387446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.402234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:43.427712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afc428-ae93-4322-bc68-f2a12005c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.428363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afc428-ae93-4322-bc68-f2a12005c458 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.428647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afc428-ae93-4322-bc68-f2a12005c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.428920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afc428-ae93-4322-bc68-f2a12005c458 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.429627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afc428-ae93-4322-bc68-f2a12005c458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.431654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afc428-ae93-4322-bc68-f2a12005c458 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.481374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:43.500963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 934/1878] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:43 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:43.502721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.503209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.503709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.515327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366370-1689-4da2-a04a-e499c8573697 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.535363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:43.537513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.601995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.602902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.603250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.603803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] PATH_INFO: `/v3/projects/b9691a2bc58b49a0b237084b9f3ff5bd` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.618822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9691a2bc58b49a0b237084b9f3ff5bd)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.623520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.652817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 935/1879] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:43.653569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.654883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.671733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f5e96-1d71-4ddc-bbfe-ee96f1dbe953 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.678990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c2ac2-3c83-4f98-8a0f-2fc758eefbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.679733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c2ac2-3c83-4f98-8a0f-2fc758eefbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.680178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c2ac2-3c83-4f98-8a0f-2fc758eefbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.680439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c2ac2-3c83-4f98-8a0f-2fc758eefbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.681141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c2ac2-3c83-4f98-8a0f-2fc758eefbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.684718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c2ac2-3c83-4f98-8a0f-2fc758eefbe9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.704708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9691a2bc58b49a0b237084b9f3ff5bd', 'request_id': 'req-d4edc848-f350-4994-8662-d5b8f71ff30a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.713237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9691a2bc58b49a0b237084b9f3ff5bd', 'request_id': 'req-d4edc848-f350-4994-8662-d5b8f71ff30a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.716534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 936/1880] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:43 2022] POST /identity/v3/users => generated 296 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:43.719217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0e1ae-df61-4365-9fc9-448e96c0206b None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.719508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0e1ae-df61-4365-9fc9-448e96c0206b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.719813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0e1ae-df61-4365-9fc9-448e96c0206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.728443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9691a2bc58b49a0b237084b9f3ff5bd', 'request_id': 'req-d4edc848-f350-4994-8662-d5b8f71ff30a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.741777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] The token cache is being invalidate because project b9691a2bc58b49a0b237084b9f3ff5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:43.742158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.742976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:43.744595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 945/1881] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:43 2022] DELETE /identity/v3/projects/b9691a2bc58b49a0b237084b9f3ff5bd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:43.745376 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.746980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5aa0e1ae-df61-4365-9fc9-448e96c0206b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:43.748420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5aa0e1ae-df61-4365-9fc9-448e96c0206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.749454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.820816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc848-f350-4994-8662-d5b8f71ff30a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.825720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6df23-e8b0-4d51-b881-82ccc656a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.826387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6df23-e8b0-4d51-b881-82ccc656a8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.826705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6df23-e8b0-4d51-b881-82ccc656a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.826960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6df23-e8b0-4d51-b881-82ccc656a8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.827655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6df23-e8b0-4d51-b881-82ccc656a8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.829430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6df23-e8b0-4d51-b881-82ccc656a8b2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.840645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 946/1882] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:43.841935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3862a9-ebdb-46e3-9eb5-6e8aaeb0e055 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.842221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3862a9-ebdb-46e3-9eb5-6e8aaeb0e055 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.842500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3862a9-ebdb-46e3-9eb5-6e8aaeb0e055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.852581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 937/1883] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:43.853459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0e1ae-df61-4365-9fc9-448e96c0206b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.864127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0e1ae-df61-4365-9fc9-448e96c0206b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.869114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.869867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.870153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.870430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] PATH_INFO: `/v3/projects/4464a44cce1b41cd82b5439049419d2c/users/0c5bbf67cab04f15b136818c9a1df059/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.875837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-9f3862a9-ebdb-46e3-9eb5-6e8aaeb0e055 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:43.877070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9f3862a9-ebdb-46e3-9eb5-6e8aaeb0e055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.885837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 947/1884] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:43.886598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3862a9-ebdb-46e3-9eb5-6e8aaeb0e055 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.893887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:43.898482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3862a9-ebdb-46e3-9eb5-6e8aaeb0e055 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:43.902341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4464a44cce1b41cd82b5439049419d2c, user_id=0c5bbf67cab04f15b136818c9a1df059, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.904982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278da8c0-be69-4cd0-bfa4-c7f25bd96531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:43.905185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.905465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da8c0-be69-4cd0-bfa4-c7f25bd96531 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.905783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da8c0-be69-4cd0-bfa4-c7f25bd96531 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.906406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da8c0-be69-4cd0-bfa4-c7f25bd96531 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.907671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da8c0-be69-4cd0-bfa4-c7f25bd96531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:43.908629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da8c0-be69-4cd0-bfa4-c7f25bd96531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:43.910519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da8c0-be69-4cd0-bfa4-c7f25bd96531 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:43.920507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 938/1885] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:43 2022] PUT /identity/v3/projects/4464a44cce1b41cd82b5439049419d2c/users/0c5bbf67cab04f15b136818c9a1df059/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:43.921360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:43.923012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.927118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 948/1886] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:43.927118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31249e-5755-4ae2-b8c0-9c90ab84f26b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:43.927118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31249e-5755-4ae2-b8c0-9c90ab84f26b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:43.927118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31249e-5755-4ae2-b8c0-9c90ab84f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:43.945681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3e31249e-5755-4ae2-b8c0-9c90ab84f26b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:43.947656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3e31249e-5755-4ae2-b8c0-9c90ab84f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:43.963492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:43.995648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037af528-afff-4828-a608-4d280f9c68d9 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.000468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.001118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.001394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.001671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] PATH_INFO: `/v3/projects/cc3d02cfc0634dfcb686980fe60e642b` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.002828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3d02cfc0634dfcb686980fe60e642b)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.004775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.010363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 949/1887] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:44.011432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31249e-5755-4ae2-b8c0-9c90ab84f26b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.021000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31249e-5755-4ae2-b8c0-9c90ab84f26b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.031554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.032209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.032538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.032830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.033879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.036722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.048311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 950/1888] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:44.049150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.063851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fb74-cbb4-4d1a-aa60-f54052d0d2b5 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.067722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3d02cfc0634dfcb686980fe60e642b', 'request_id': 'req-15176023-0521-48c9-b28a-c7069003e7eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.074242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3d02cfc0634dfcb686980fe60e642b', 'request_id': 'req-15176023-0521-48c9-b28a-c7069003e7eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.083002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3d02cfc0634dfcb686980fe60e642b', 'request_id': 'req-15176023-0521-48c9-b28a-c7069003e7eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.097613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] The token cache is being invalidate because project cc3d02cfc0634dfcb686980fe60e642b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:44.098052 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.098839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.104609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 939/1889] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:43 2022] DELETE /identity/v3/projects/cc3d02cfc0634dfcb686980fe60e642b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:44.105306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.106741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.139997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.140646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.141171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.141450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.142118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.144097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.187701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 951/1890] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:44 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:44.188528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.189809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15176023-0521-48c9-b28a-c7069003e7eb admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.192076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.254141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.254998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.255679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.255679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.256330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:44.256639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.258330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.271102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 940/1891] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:44.272497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59440b-e234-406d-a5e5-5a078a55778e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.275388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.277876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.279843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.280739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.281195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.281645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] PATH_INFO: `/v3/projects/4464a44cce1b41cd82b5439049419d2c/users/0c5bbf67cab04f15b136818c9a1df059/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.283905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4464a44cce1b41cd82b5439049419d2c, user_id=0c5bbf67cab04f15b136818c9a1df059, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.286539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:44.286758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.291021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de950b1-f1f8-42d6-8ff9-5cbde74ad1e4 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.293879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:44.300858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 952/1892] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:44 2022] PUT /identity/v3/projects/4464a44cce1b41cd82b5439049419d2c/users/0c5bbf67cab04f15b136818c9a1df059/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:44.302014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.312565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.368999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.370621 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.371367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.371840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] PATH_INFO: `/v3/users/0e0163545d4840dfb1fb4a7d111317d0` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.373867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0163545d4840dfb1fb4a7d111317d0)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.376113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.385333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6869-c49c-48f4-aa50-8bb0e7eb59d8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.390083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.390717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.391015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.391276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.391971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.393898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.423409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 953/1893] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:44 2022] POST /identity/v3/users => generated 282 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:44.424222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.434675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65cbc3-ca59-443e-a909-6453df380488 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.436001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0163545d4840dfb1fb4a7d111317d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.440121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.440740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.441030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.441313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.441979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.444027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.449016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0163545d4840dfb1fb4a7d111317d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.456160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0163545d4840dfb1fb4a7d111317d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.457013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0163545d4840dfb1fb4a7d111317d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.466623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1d517ee3-9cab-4875-bd4b-4986df00e728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0163545d4840dfb1fb4a7d111317d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:44.472824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 941/1894] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:44 2022] DELETE /identity/v3/users/0e0163545d4840dfb1fb4a7d111317d0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:44.474573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 954/1895] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:44 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:44.475484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.477366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccced-402d-4623-b83c-164a762dae3a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.477656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccced-402d-4623-b83c-164a762dae3a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.477937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccced-402d-4623-b83c-164a762dae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.486831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.520306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4d0ccced-402d-4623-b83c-164a762dae3a None None] MFA Rules not processed for user `0c5bbf67cab04f15b136818c9a1df059`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:44.521640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4d0ccced-402d-4623-b83c-164a762dae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.560377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49b290-5eed-4df4-bcff-61d6d90c691e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.565927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.566571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.566853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.567176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.567907 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.569626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.581825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 955/1896] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:44.586078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.586078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.599099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229458f-a628-4704-9207-96d7dd49a13b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.605393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.606105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.606730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.606730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.607512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.609688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.614217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 942/1897] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:44.615286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ccced-402d-4623-b83c-164a762dae3a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.645973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ccced-402d-4623-b83c-164a762dae3a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.654556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.655252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.655903 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.656331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.658065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 956/1898] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:44 2022] POST /identity/v3/users => generated 293 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:44.659105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.660582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.663730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.665430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.669644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:44.688292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 943/1899] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:44.690876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.705518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa5931-bd2d-449e-8b88-2c21a72da4a6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.711242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.712125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.712819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.713233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.714073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.715906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.728248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:44.728919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 944/1900] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:44.733060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.735524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29fd25-ba0f-4191-89f8-39682fa54b13 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.743795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.744910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.745563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.746196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.746586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50584532-4f5c-4064-b394-315cfef9c431 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.748986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.752018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.752898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.753175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.753669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] PATH_INFO: `/v3/projects/b3e7ad0588044408a65b363b2b25a28e/users/22a611fc1bad41c4ac5d0506cf91a336/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.773901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e7ad0588044408a65b363b2b25a28e, user_id=22a611fc1bad41c4ac5d0506cf91a336, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.778160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.803885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 945/1901] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:44 2022] PUT /identity/v3/projects/b3e7ad0588044408a65b363b2b25a28e/users/22a611fc1bad41c4ac5d0506cf91a336/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:44.806003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.853353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.855112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:44.868304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 957/1902] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:44.869477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:44.872505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:44.894599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87825b1-3c84-4d71-b4a2-e95c70986d16 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.961179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daec156-a1ed-451a-9818-96b9b028fd30 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:44.976996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d47b2-b2b1-4a18-b67e-a609452f470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:44.978496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d47b2-b2b1-4a18-b67e-a609452f470c admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:44.979073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d47b2-b2b1-4a18-b67e-a609452f470c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:44.979477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d47b2-b2b1-4a18-b67e-a609452f470c admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:44.980340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d47b2-b2b1-4a18-b67e-a609452f470c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:44.982098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d47b2-b2b1-4a18-b67e-a609452f470c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.007548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 946/1903] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:45.009305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c43310-1907-41b0-ab36-60873ef3d5ab None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.012781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c43310-1907-41b0-ab36-60873ef3d5ab None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.013303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c43310-1907-41b0-ab36-60873ef3d5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.014666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.015513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.015866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.016178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] PATH_INFO: `/v3/projects/e3b17e44cbcc4b26a1b3c5294469cc22` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.017465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b17e44cbcc4b26a1b3c5294469cc22)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:45.019575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.059262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e9c43310-1907-41b0-ab36-60873ef3d5ab None None] MFA Rules not processed for user `22a611fc1bad41c4ac5d0506cf91a336`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:45.061045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e9c43310-1907-41b0-ab36-60873ef3d5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.154502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b17e44cbcc4b26a1b3c5294469cc22', 'request_id': 'req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.163241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 947/1904] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:45.166674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c43310-1907-41b0-ab36-60873ef3d5ab None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.172818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b17e44cbcc4b26a1b3c5294469cc22', 'request_id': 'req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.194041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b17e44cbcc4b26a1b3c5294469cc22', 'request_id': 'req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.202267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c43310-1907-41b0-ab36-60873ef3d5ab None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:45.213834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] The token cache is being invalidate because project e3b17e44cbcc4b26a1b3c5294469cc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:45.214177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.214946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-e546533f-c1d2-4c0a-865c-eaad6dceb0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.229974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 958/1905] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:44 2022] DELETE /identity/v3/projects/e3b17e44cbcc4b26a1b3c5294469cc22 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:45.234673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ae6c-f144-49c3-b3bf-9796b7628ff5 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.235089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ae6c-f144-49c3-b3bf-9796b7628ff5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.235443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ae6c-f144-49c3-b3bf-9796b7628ff5 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.237400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 959/1906] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:33:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:33:45.238374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8ae6c-f144-49c3-b3bf-9796b7628ff5 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.240721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bca8ae6c-f144-49c3-b3bf-9796b7628ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.302444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:45.342674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:45.360120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.361725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.362191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.362643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] PATH_INFO: `/v3/projects/4c279c4fe70941c0876fdf40d18b5a3a/users/bd8a120272ea498b8bd49f1cc8d6efc9/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.380786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c279c4fe70941c0876fdf40d18b5a3a, user_id=bd8a120272ea498b8bd49f1cc8d6efc9, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:45.384650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.401443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8ae6c-f144-49c3-b3bf-9796b7628ff5 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:45.406129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 948/1907] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:45 2022] PUT /identity/v3/projects/4c279c4fe70941c0876fdf40d18b5a3a/users/bd8a120272ea498b8bd49f1cc8d6efc9/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:45.407535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.417638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.502654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281b15-8c6e-4a2a-8dcc-1b93d83daf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.503401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281b15-8c6e-4a2a-8dcc-1b93d83daf67 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.503855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281b15-8c6e-4a2a-8dcc-1b93d83daf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.504908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281b15-8c6e-4a2a-8dcc-1b93d83daf67 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.505869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281b15-8c6e-4a2a-8dcc-1b93d83daf67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:45.515343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b8b06-779f-49aa-b71e-be0972a4ef5a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:45.515440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281b15-8c6e-4a2a-8dcc-1b93d83daf67 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.523995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.524912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.525058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.525479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] PATH_INFO: `/v3/users/306c61f13d7d479fb73c6372d7068ea7` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.526815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306c61f13d7d479fb73c6372d7068ea7)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:45.528956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.543710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 960/1908] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:45 2022] POST /identity/v3/projects => generated 365 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:45.543914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.544193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.544474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.565317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:45.566662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.593914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306c61f13d7d479fb73c6372d7068ea7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.610561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306c61f13d7d479fb73c6372d7068ea7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.620474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306c61f13d7d479fb73c6372d7068ea7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.621492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306c61f13d7d479fb73c6372d7068ea7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.633146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0094bb8e-e779-4ceb-8759-8fe9c6e001b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306c61f13d7d479fb73c6372d7068ea7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:45.640344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 949/1909] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:45 2022] DELETE /identity/v3/users/306c61f13d7d479fb73c6372d7068ea7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:45.641764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.642053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.642322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.673714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 961/1910] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:33:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:45.675738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.680227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.697988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] MFA Rules not processed for user `bd8a120272ea498b8bd49f1cc8d6efc9`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:45.699664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.749958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:45.773629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:45.781114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2b413-cca6-4b49-b116-ec25597c2165 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:45.792154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 950/1911] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:45.792154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.792154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.876111 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.877295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.877593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.877873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.878637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:45.880536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.914945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ff4d6-f15f-47cd-9bab-c0317ef0e466 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:45.920780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.921604 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.921909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.922180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.932442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:45.934252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.945435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 962/1912] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:45 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:45.947894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 951/1913] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:45.948014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.948967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.951521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:45.961182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaa90-6f0a-400c-931e-66bf46a9dc0d service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:45.966326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.966955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.967231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.967968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.968229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:45.970686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:45.980211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d5cf2-2d69-45b7-9db9-954c6a8e3eff admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:45.988161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 952/1914] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:45.990227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:45.993672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:45.998365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:45.998651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:45.998926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:45.999634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.001770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.011939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c69a73-66fe-4b2d-b5ac-3a561ef2819c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.026708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.027366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.027666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.027947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] PATH_INFO: `/v3/projects/6d41a217bc214372a290a2b84c05280a/users/7410ebdc84b843cc9a21c95a96543518/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.054419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 963/1915] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:45 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:46.055357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.056843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d41a217bc214372a290a2b84c05280a, user_id=7410ebdc84b843cc9a21c95a96543518, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.058780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.061705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.106225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 953/1916] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:45 2022] PUT /identity/v3/projects/6d41a217bc214372a290a2b84c05280a/users/7410ebdc84b843cc9a21c95a96543518/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:46.107404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.156936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2089a2-c3e9-4e2d-8115-74bf204e7d23 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.236363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eab93-0823-4d09-ad7c-95d02a501876 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.243337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.244311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.244601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.244932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.245625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.247608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.279854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.279854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.280554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.280554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] PATH_INFO: `/v3/projects/c41c4810d64e4680bbd358a738134d1e` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.281979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41c4810d64e4680bbd358a738134d1e)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.285363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.292061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 954/1917] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:46 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:46.295793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.308635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40401153-18f3-4c05-9cad-ac0a877ddf22 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.315158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.316209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.316495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.316773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.318290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.319946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.337301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 955/1918] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:46.338802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.350929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f32925-8a73-47bf-b967-f166bd6a2abb admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.353588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:46.360973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.362907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.362907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.362907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.363376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.365070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.368471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:46.381145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 956/1919] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:46.383684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.411280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41c4810d64e4680bbd358a738134d1e', 'request_id': 'req-cc2edcb4-e83e-4885-a859-e8d927f0302b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:46.415976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e9e9-83d0-4931-9a25-ef74e89431c4 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.424437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41c4810d64e4680bbd358a738134d1e', 'request_id': 'req-cc2edcb4-e83e-4885-a859-e8d927f0302b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:46.450001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41c4810d64e4680bbd358a738134d1e', 'request_id': 'req-cc2edcb4-e83e-4885-a859-e8d927f0302b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:46.464509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] The token cache is being invalidate because project c41c4810d64e4680bbd358a738134d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:46.465176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:46.466092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:46.468105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 964/1920] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:46 2022] DELETE /identity/v3/projects/c41c4810d64e4680bbd358a738134d1e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:46.469663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.471605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.502965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.503701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.503989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.504270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] PATH_INFO: `/v3/projects/6d41a217bc214372a290a2b84c05280a/users/7410ebdc84b843cc9a21c95a96543518/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.506404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d41a217bc214372a290a2b84c05280a, user_id=7410ebdc84b843cc9a21c95a96543518, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.510265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.528936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 957/1921] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:46 2022] PUT /identity/v3/projects/6d41a217bc214372a290a2b84c05280a/users/7410ebdc84b843cc9a21c95a96543518/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:46.529935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.532228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.569497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2edcb4-e83e-4885-a859-e8d927f0302b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.630773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f10ed4-985e-4a6a-bc45-f180b7d89920 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.639431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cec8d-8a53-4a54-b063-b1c45549fee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.640245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cec8d-8a53-4a54-b063-b1c45549fee2 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.640431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cec8d-8a53-4a54-b063-b1c45549fee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.640709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cec8d-8a53-4a54-b063-b1c45549fee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.642862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c54cec8d-8a53-4a54-b063-b1c45549fee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.652811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f543bc-55ba-44dc-bdb3-589c61b0fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.653993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f543bc-55ba-44dc-bdb3-589c61b0fcea admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.654515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f543bc-55ba-44dc-bdb3-589c61b0fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.654878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f543bc-55ba-44dc-bdb3-589c61b0fcea admin admin] PATH_INFO: `/v3/projects/a1b27586e56e4b9fb45262ec6794dd15/users/ccbacbcf61b347959b1ed0a18c3bf847/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.670826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f543bc-55ba-44dc-bdb3-589c61b0fcea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b27586e56e4b9fb45262ec6794dd15, user_id=ccbacbcf61b347959b1ed0a18c3bf847, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.673687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f543bc-55ba-44dc-bdb3-589c61b0fcea admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.689795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 965/1922] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:46 2022] PUT /identity/v3/projects/a1b27586e56e4b9fb45262ec6794dd15/users/ccbacbcf61b347959b1ed0a18c3bf847/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:46.693701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03abb2-7983-48ba-86b7-dc58990bb27e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.693994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03abb2-7983-48ba-86b7-dc58990bb27e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.694278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03abb2-7983-48ba-86b7-dc58990bb27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.716073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0a03abb2-7983-48ba-86b7-dc58990bb27e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:46.717559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0a03abb2-7983-48ba-86b7-dc58990bb27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.732358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cec8d-8a53-4a54-b063-b1c45549fee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.734140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cec8d-8a53-4a54-b063-b1c45549fee2 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.748032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 958/1923] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:46.749346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b7dd-4df2-4b47-87f1-0c89b1d7b43d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.749835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b7dd-4df2-4b47-87f1-0c89b1d7b43d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.750119 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b7dd-4df2-4b47-87f1-0c89b1d7b43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.777668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:46.788726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1bd6b7dd-4df2-4b47-87f1-0c89b1d7b43d None None] MFA Rules not processed for user `7410ebdc84b843cc9a21c95a96543518`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:46.790215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1bd6b7dd-4df2-4b47-87f1-0c89b1d7b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.816540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 966/1924] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:46.821427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03abb2-7983-48ba-86b7-dc58990bb27e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.827170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:46.835016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03abb2-7983-48ba-86b7-dc58990bb27e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.860009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fbd89-4a01-4646-af3e-ee65031c04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.860651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fbd89-4a01-4646-af3e-ee65031c04b3 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.860942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fbd89-4a01-4646-af3e-ee65031c04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.861253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fbd89-4a01-4646-af3e-ee65031c04b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.861969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fbd89-4a01-4646-af3e-ee65031c04b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.864533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fbd89-4a01-4646-af3e-ee65031c04b3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.885067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 967/1925] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:46.885067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.885067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.885067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.904174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 959/1926] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:46.905252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b7dd-4df2-4b47-87f1-0c89b1d7b43d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.915054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:46.916963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.922090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b7dd-4df2-4b47-87f1-0c89b1d7b43d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:46.938083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 968/1927] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:46.938083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.938083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:46.938427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:46.938427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:46.938427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:46.938427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] PATH_INFO: `/v3/projects/a1b27586e56e4b9fb45262ec6794dd15/users/ccbacbcf61b347959b1ed0a18c3bf847/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:46.938769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b27586e56e4b9fb45262ec6794dd15, user_id=ccbacbcf61b347959b1ed0a18c3bf847, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:46.939877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:46.959666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 960/1928] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:46 2022] PUT /identity/v3/projects/a1b27586e56e4b9fb45262ec6794dd15/users/ccbacbcf61b347959b1ed0a18c3bf847/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:46.968376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:46.997011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3d39a-4f56-4c91-96dc-e1722f4f702f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.040844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c3ae4-ee03-46f2-a2f3-9fdaee491f11 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.045590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2328c-2e06-4af0-8e4c-9573c2cb72d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.046220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2328c-2e06-4af0-8e4c-9573c2cb72d1 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.046498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2328c-2e06-4af0-8e4c-9573c2cb72d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.046775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2328c-2e06-4af0-8e4c-9573c2cb72d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.047470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2328c-2e06-4af0-8e4c-9573c2cb72d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:47.047807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2328c-2e06-4af0-8e4c-9573c2cb72d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.049553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2328c-2e06-4af0-8e4c-9573c2cb72d1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.051903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.052808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.053093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.053370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.065887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 961/1929] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:47.065887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9065-6127-4065-9dd0-741321028056 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.065887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9065-6127-4065-9dd0-741321028056 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.065887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9065-6127-4065-9dd0-741321028056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.095198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d23d9065-6127-4065-9dd0-741321028056 None None] MFA Rules not processed for user `ccbacbcf61b347959b1ed0a18c3bf847`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:47.096535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d23d9065-6127-4065-9dd0-741321028056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:47.118529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.120047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.130787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 969/1930] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:47.132006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.142953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da5a0-7fdc-4156-bcfe-082b16553423 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.148331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.149305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.149864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.150097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.151021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.152906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.170534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 962/1931] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:47.182286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9065-6127-4065-9dd0-741321028056 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.191518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 970/1932] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:47 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:47.195570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.196347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9065-6127-4065-9dd0-741321028056 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.201735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:47.230285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:47.249834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.250490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.250773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.251048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.266676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb161-30ac-408a-9dfb-6feb163ed562 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.271341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.272007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.272287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.272561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.273331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.275291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.296601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 971/1933] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:47 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:47.297629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.307454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d999d4d-d6a8-4829-bdd4-95d75e3fb61d admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.311185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.312422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.312756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.313073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.315105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:47.316073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.317535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.327227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 963/1934] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:47.328068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.340451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4870d4-88e6-4e5e-8e88-1ddd88811aac service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.346050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.346695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.346982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.347259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.347989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.350120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.362761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 964/1935] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:47.370194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.382823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0042-2ce2-42f0-a259-fa1edc3b1d48 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.388193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f69bf7-81dc-49e9-a5f7-eab97358f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.388834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69bf7-81dc-49e9-a5f7-eab97358f260 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.389206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69bf7-81dc-49e9-a5f7-eab97358f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.389486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69bf7-81dc-49e9-a5f7-eab97358f260 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.390182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f69bf7-81dc-49e9-a5f7-eab97358f260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.391932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f69bf7-81dc-49e9-a5f7-eab97358f260 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.393817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.395409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.406150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 972/1936] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:47.407022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 965/1937] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:33:47.407601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.418844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614fd01-495f-4530-a892-e3fafb0bad42 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.424497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.425289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.425609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.425956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] PATH_INFO: `/v3/projects/b479844b035543eba4299250f026507a/users/353574593f544d0b90fc51d819430ec8/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.457013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b479844b035543eba4299250f026507a, user_id=353574593f544d0b90fc51d819430ec8, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.459915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.484948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 973/1938] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:47 2022] PUT /identity/v3/projects/b479844b035543eba4299250f026507a/users/353574593f544d0b90fc51d819430ec8/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:47.496849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f63f-7d2f-472d-901b-31a62f2498d8 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.497162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f63f-7d2f-472d-901b-31a62f2498d8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.497428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f63f-7d2f-472d-901b-31a62f2498d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.529257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7638f63f-7d2f-472d-901b-31a62f2498d8 None None] MFA Rules not processed for user `353574593f544d0b90fc51d819430ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:47.530489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7638f63f-7d2f-472d-901b-31a62f2498d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:47.647918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 966/1939] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:47.649349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.733693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42d7d-4383-4848-be4f-7bdfdf318e20 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.738900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.739610 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.740037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.740379 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.741468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.744115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.759935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:47.779207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 974/1940] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:47 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:47.780522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f63f-7d2f-472d-901b-31a62f2498d8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.792374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f63f-7d2f-472d-901b-31a62f2498d8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.841849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:47.853687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.854633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.854932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.855245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.856077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.858219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.891294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 967/1941] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:47 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:47.896573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.909461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd21b6-8cac-4025-a162-4f31a8b40d9a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.914084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.915187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.915557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.915959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.916789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.918683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:47.934486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 975/1942] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:47.937503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:47.952722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999bf3b-69f0-4e57-89e8-8762917ca670 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:47.958416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:47.959359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:47.959820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:47.960307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] PATH_INFO: `/v3/projects/ca438f963f144cfcb1fe977523718fd5/users/a604ebd6ef5c4fb4a82d6fb1d9698111/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:47.982603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca438f963f144cfcb1fe977523718fd5, user_id=a604ebd6ef5c4fb4a82d6fb1d9698111, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:47.986627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:48.011826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 968/1943] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:47 2022] PUT /identity/v3/projects/ca438f963f144cfcb1fe977523718fd5/users/a604ebd6ef5c4fb4a82d6fb1d9698111/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:48.015997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:48.029357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:48.046635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37970ac-9fcb-4cbb-bce1-fa1c633972ca admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:48.137787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:48.138505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:48.138791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77804-fefa-45f9-8543-b7f672867c29 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:48.138922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:48.139118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:48.139860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:48.141592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:48.145551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:48.146221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:48.147112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:48.147437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] PATH_INFO: `/v3/users/bd8a120272ea498b8bd49f1cc8d6efc9` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:48.148961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8a120272ea498b8bd49f1cc8d6efc9)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:48.150920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:48.154153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 976/1944] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:48.158333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:48.168608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bd3e6-0e23-4997-9a56-30db30270896 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:48.174661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767d676-c21d-42ea-b79d-6529d633c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:48.175536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d676-c21d-42ea-b79d-6529d633c459 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:48.176620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d676-c21d-42ea-b79d-6529d633c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:48.176909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d676-c21d-42ea-b79d-6529d633c459 admin admin] PATH_INFO: `/v3/projects/ca438f963f144cfcb1fe977523718fd5/users/a604ebd6ef5c4fb4a82d6fb1d9698111/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:48.178946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767d676-c21d-42ea-b79d-6529d633c459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca438f963f144cfcb1fe977523718fd5, user_id=a604ebd6ef5c4fb4a82d6fb1d9698111, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:48.181919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767d676-c21d-42ea-b79d-6529d633c459 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:48.194994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 977/1945] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:48 2022] PUT /identity/v3/projects/ca438f963f144cfcb1fe977523718fd5/users/a604ebd6ef5c4fb4a82d6fb1d9698111/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:48.207551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:48.207975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:48.208438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:48.224364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8a120272ea498b8bd49f1cc8d6efc9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:48.238121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8a120272ea498b8bd49f1cc8d6efc9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:48.240051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] MFA Rules not processed for user `a604ebd6ef5c4fb4a82d6fb1d9698111`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:48.242078 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:48.245594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8a120272ea498b8bd49f1cc8d6efc9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:48.246435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8a120272ea498b8bd49f1cc8d6efc9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:48.254835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-00ccf2bf-aa3d-4500-9200-0a2560847701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8a120272ea498b8bd49f1cc8d6efc9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:48.262191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 969/1946] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:48 2022] DELETE /identity/v3/users/bd8a120272ea498b8bd49f1cc8d6efc9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:48.266202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:48.266489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:48.266904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:48.286916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:48.288185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:48.339690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 978/1947] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:48.349985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:48.351251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:48.352842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:48.402189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 970/1948] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:48.408751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:48.410565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:48.434751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f151a1a-5241-4632-80f1-b18819f8378e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:48.439314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:48.496552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49d26b-4e0f-41a8-b41d-683965675993 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:48.502952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:48.503609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:48.504178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:48.504462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:48.509675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a6b9a-f8eb-4a4a-8433-6e474dda0600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:48.510570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a6b9a-f8eb-4a4a-8433-6e474dda0600 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:48.510965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a6b9a-f8eb-4a4a-8433-6e474dda0600 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:48.511777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a6b9a-f8eb-4a4a-8433-6e474dda0600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:48.515904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:48.518069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:48.530958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 971/1949] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:48.586287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a6b9a-f8eb-4a4a-8433-6e474dda0600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:48.587812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a6b9a-f8eb-4a4a-8433-6e474dda0600 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:48.601173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 979/1950] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:49.192341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:49.193906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:49.224572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12811412-cdf1-4f06-b9fe-dc6dd0c69947 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:49.238331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:49.239172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:49.239665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:49.240340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] PATH_INFO: `/v3/users/353574593f544d0b90fc51d819430ec8` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:49.244846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] RBAC: Authorizing `identity:delete_user(user_id=353574593f544d0b90fc51d819430ec8)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:49.250320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:49.321171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353574593f544d0b90fc51d819430ec8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.338366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353574593f544d0b90fc51d819430ec8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.345973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353574593f544d0b90fc51d819430ec8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.346712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353574593f544d0b90fc51d819430ec8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.356144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353574593f544d0b90fc51d819430ec8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.367109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 972/1951] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:49 2022] DELETE /identity/v3/users/353574593f544d0b90fc51d819430ec8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:49.369691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:49.370576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:49.370955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:49.393835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:49.395277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:49.505015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:49.506485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:49.543069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 980/1952] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:49.557085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:49.559700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:49.599132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:49.617126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d10b9-f830-4a67-ba68-e85e7d8a802c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:49.623442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:49.624387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:49.624671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:49.625543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] PATH_INFO: `/v3/projects/4c279c4fe70941c0876fdf40d18b5a3a` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:49.627137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c279c4fe70941c0876fdf40d18b5a3a)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:49.628832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc9d6-13a4-48ac-b8a5-306b1c885ea9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:49.630268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:49.633531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:49.634372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:49.634741 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:49.635035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:49.645420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:49.646864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:49.652493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:49.661801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 981/1953] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:49.697220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c279c4fe70941c0876fdf40d18b5a3a', 'request_id': 'req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.704499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c279c4fe70941c0876fdf40d18b5a3a', 'request_id': 'req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.712857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c279c4fe70941c0876fdf40d18b5a3a', 'request_id': 'req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.725130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] The token cache is being invalidate because project 4c279c4fe70941c0876fdf40d18b5a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:49.725566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.726990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.728368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 973/1954] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:49 2022] DELETE /identity/v3/projects/4c279c4fe70941c0876fdf40d18b5a3a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:49.733921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:49.745585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2023da-539c-48dd-b723-28cf632da0fa service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:49.808973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:49.809778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:49.810070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:49.810345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] PATH_INFO: `/v3/users/ccbacbcf61b347959b1ed0a18c3bf847` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:49.811578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbacbcf61b347959b1ed0a18c3bf847)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:49.814121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:49.865405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbacbcf61b347959b1ed0a18c3bf847'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.883112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbacbcf61b347959b1ed0a18c3bf847'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.884214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbacbcf61b347959b1ed0a18c3bf847'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.892469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbacbcf61b347959b1ed0a18c3bf847'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.899814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbacbcf61b347959b1ed0a18c3bf847'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:49.905833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 982/1955] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:49 2022] DELETE /identity/v3/users/ccbacbcf61b347959b1ed0a18c3bf847 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:50.093302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:50.095184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:50.110827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1c7e-8c71-4d1a-a1ef-34fb9de0b1fa admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:50.209402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:50.210993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:50.228140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:50.229010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.229330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.229677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] PATH_INFO: `/v3/projects/b479844b035543eba4299250f026507a` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.231024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b479844b035543eba4299250f026507a)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:50.233958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:50.306734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b479844b035543eba4299250f026507a', 'request_id': 'req-142baa96-96ce-44fb-bf56-f8deef2456d9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.316471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b479844b035543eba4299250f026507a', 'request_id': 'req-142baa96-96ce-44fb-bf56-f8deef2456d9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.317902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d229521-d83a-49ab-8d66-cb0d7293cb4a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:50.327382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b479844b035543eba4299250f026507a', 'request_id': 'req-142baa96-96ce-44fb-bf56-f8deef2456d9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.340288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] The token cache is being invalidate because project b479844b035543eba4299250f026507a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:50.340573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.341224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.351702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 974/1956] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:50 2022] DELETE /identity/v3/projects/b479844b035543eba4299250f026507a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:50.356525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:50.358483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:50.359445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:50.394674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:50.415390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:50.416121 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.416405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.416682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] PATH_INFO: `/v3/projects/a1b27586e56e4b9fb45262ec6794dd15` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.417882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b27586e56e4b9fb45262ec6794dd15)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:50.420018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:50.459907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142baa96-96ce-44fb-bf56-f8deef2456d9 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:50.466404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:50.467659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.467954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.468233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] PATH_INFO: `/v3/users/a604ebd6ef5c4fb4a82d6fb1d9698111` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.469593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a604ebd6ef5c4fb4a82d6fb1d9698111)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:50.472380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:50.480237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b27586e56e4b9fb45262ec6794dd15', 'request_id': 'req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.489957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b27586e56e4b9fb45262ec6794dd15', 'request_id': 'req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.503929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b27586e56e4b9fb45262ec6794dd15', 'request_id': 'req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.518173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] The token cache is being invalidate because project a1b27586e56e4b9fb45262ec6794dd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:50.518555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.519856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b1d6a11a-5e77-4a26-ab3e-4ddcf074ec72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.521991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 983/1957] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:50 2022] DELETE /identity/v3/projects/a1b27586e56e4b9fb45262ec6794dd15 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:50.527761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.527761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.527761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.550972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a604ebd6ef5c4fb4a82d6fb1d9698111'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.562589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:50.563908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:50.581455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a604ebd6ef5c4fb4a82d6fb1d9698111'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.595728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a604ebd6ef5c4fb4a82d6fb1d9698111'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.596527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a604ebd6ef5c4fb4a82d6fb1d9698111'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.607866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e351c0b8-269e-4533-8971-4a21d4191270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a604ebd6ef5c4fb4a82d6fb1d9698111'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:50.616826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 975/1958] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:50 2022] DELETE /identity/v3/users/a604ebd6ef5c4fb4a82d6fb1d9698111 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:50.666382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 984/1959] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:50.674104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34183-2490-4bd8-8b42-913f2f3c8866 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.674912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34183-2490-4bd8-8b42-913f2f3c8866 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.675532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34183-2490-4bd8-8b42-913f2f3c8866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.725696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:50.728057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:50.732486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-66e34183-2490-4bd8-8b42-913f2f3c8866 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:50.733938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-66e34183-2490-4bd8-8b42-913f2f3c8866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:50.746001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79067-5c78-4e97-982b-f1d0ba91ea04 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:50.834724 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:50.855266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:50.858983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.859512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.859894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] PATH_INFO: `/v3/users/73d8a329dd5d46bbbb900c3248ee0f03` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.861546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d8a329dd5d46bbbb900c3248ee0f03)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:50.867681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:50.880855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 976/1960] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:50.882659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e34183-2490-4bd8-8b42-913f2f3c8866 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:50.901386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e34183-2490-4bd8-8b42-913f2f3c8866 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:50.909265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:50.910205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.910730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.911661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.913450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:50.914291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:50.916880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:50.938342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 977/1961] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:33:50.939802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:50.960451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d9c2f-0ba4-4ae6-ad63-7edd67bbc5f6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:50.972275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:50.973251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:50.973789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:50.974325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:50.975205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:50.977829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:50.999769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d8a329dd5d46bbbb900c3248ee0f03'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.002709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:51.015825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d8a329dd5d46bbbb900c3248ee0f03'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.017027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d8a329dd5d46bbbb900c3248ee0f03'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.036006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d8a329dd5d46bbbb900c3248ee0f03'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.037875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 978/1962] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:50 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:51.043159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.047087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.049637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-21e79689-5cb1-4eb6-a806-75e51a41af2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d8a329dd5d46bbbb900c3248ee0f03'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.063697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 985/1963] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:50 2022] DELETE /identity/v3/users/73d8a329dd5d46bbbb900c3248ee0f03 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:51.067641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.068636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.072013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.100692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:51.100859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.187826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2634-7c56-4ffd-98f8-cd6216c7e489 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.192536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.193183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.193544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.193737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.194552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.196547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.196991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 986/1964] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:51.197833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.199200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.221818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ecdcd-4425-4d2a-ba43-14db6726877e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.228593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.229437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.229960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 979/1965] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:51.231514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.232885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.233214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] PATH_INFO: `/v3/projects/ca438f963f144cfcb1fe977523718fd5` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.234752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca438f963f144cfcb1fe977523718fd5)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.237197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.242869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.315725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca438f963f144cfcb1fe977523718fd5', 'request_id': 'req-9e9f3724-6127-426a-9e67-c577f9c52d9c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.315725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca438f963f144cfcb1fe977523718fd5', 'request_id': 'req-9e9f3724-6127-426a-9e67-c577f9c52d9c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.318338 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca438f963f144cfcb1fe977523718fd5', 'request_id': 'req-9e9f3724-6127-426a-9e67-c577f9c52d9c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.328578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:51.333272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] The token cache is being invalidate because project ca438f963f144cfcb1fe977523718fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:51.333960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.336099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:51.342514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 987/1966] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:51 2022] DELETE /identity/v3/projects/ca438f963f144cfcb1fe977523718fd5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:51.343766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.346062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.356078 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8b0a3-a48c-43a9-be1b-17a0ab308a60 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.420289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3724-6127-426a-9e67-c577f9c52d9c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.425786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d8158-2bc1-4703-bf1c-56f5bfded2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.428642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8158-2bc1-4703-bf1c-56f5bfded2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.428642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8158-2bc1-4703-bf1c-56f5bfded2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.428642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8158-2bc1-4703-bf1c-56f5bfded2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.428642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d8158-2bc1-4703-bf1c-56f5bfded2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.429541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d8158-2bc1-4703-bf1c-56f5bfded2a8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.437484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.438361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.438650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.438927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.440910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.441360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 988/1967] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:51.442762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead40c-8ef1-49fc-a4d8-df4eb8340687 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.443053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead40c-8ef1-49fc-a4d8-df4eb8340687 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.443330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead40c-8ef1-49fc-a4d8-df4eb8340687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.458029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.459533 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.468343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-dbead40c-8ef1-49fc-a4d8-df4eb8340687 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:51.469908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dbead40c-8ef1-49fc-a4d8-df4eb8340687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.470934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 980/1968] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:51.482284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 989/1969] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:51.484881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.490453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e3787-ad4a-4f3f-948d-b1b2e7c39ab5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.490934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e3787-ad4a-4f3f-948d-b1b2e7c39ab5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.491350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e3787-ad4a-4f3f-948d-b1b2e7c39ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.508879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167baf9c-53e2-4e3f-9446-fe6766d58154 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.515938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.516681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.516963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.517234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.518195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.520688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.534634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-450e3787-ad4a-4f3f-948d-b1b2e7c39ab5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:51.535936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 981/1970] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:51.536165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-450e3787-ad4a-4f3f-948d-b1b2e7c39ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.539761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.549466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 990/1971] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:51.551381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b6fc-893e-4f29-8004-6e2323c432e5 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.554032 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e3787-ad4a-4f3f-948d-b1b2e7c39ab5 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.560322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb1567-37bf-48a9-8d3e-7bf5869b9ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.561035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb1567-37bf-48a9-8d3e-7bf5869b9ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.562304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb1567-37bf-48a9-8d3e-7bf5869b9ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.562304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb1567-37bf-48a9-8d3e-7bf5869b9ba2 admin admin] PATH_INFO: `/v3/projects/da2140d405324b83835ea5b942ab3b7f/users/b9454c91512e423ea71d45ff542fd338/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.567729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e3787-ad4a-4f3f-948d-b1b2e7c39ab5 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.575258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.576070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.577029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.577632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.578479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:51.578839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.580717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.587990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb1567-37bf-48a9-8d3e-7bf5869b9ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2140d405324b83835ea5b942ab3b7f, user_id=b9454c91512e423ea71d45ff542fd338, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.592580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb1567-37bf-48a9-8d3e-7bf5869b9ba2 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.594192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 991/1972] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:51.599212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.612768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc44f-8510-47ab-baf4-0699b1e77b6e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.617812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 982/1973] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:51 2022] PUT /identity/v3/projects/da2140d405324b83835ea5b942ab3b7f/users/b9454c91512e423ea71d45ff542fd338/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:51.629527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577492-1a1c-42ec-94c9-8ce0c1c3b793 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.630096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577492-1a1c-42ec-94c9-8ce0c1c3b793 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.630610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577492-1a1c-42ec-94c9-8ce0c1c3b793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.657174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:51.669169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-44577492-1a1c-42ec-94c9-8ce0c1c3b793 None None] MFA Rules not processed for user `b9454c91512e423ea71d45ff542fd338`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:51.672353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-44577492-1a1c-42ec-94c9-8ce0c1c3b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.692938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.693863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.694151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.694429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.695125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.697958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.735934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 992/1974] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:51.740848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.764007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 983/1975] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:51.768511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577492-1a1c-42ec-94c9-8ce0c1c3b793 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.779322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577492-1a1c-42ec-94c9-8ce0c1c3b793 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.814905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:51.820191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158fa79-dc1d-46e0-9762-7a4cf2222f53 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:51.836693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.837575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.837861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.838143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.839418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.841476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.855261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:51.856260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:51.856552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:51.856875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:51.857629 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:51.861053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:51.894838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 993/1976] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:51.894838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.896577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:51.906325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 984/1977] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:51 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:51.906325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:51.912706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab230-308a-44cd-82fe-0dccd95b214c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.001722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.001722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.001722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.001722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] PATH_INFO: `/v3/projects/30f31f8a2de645568726eeb8b7d0e465` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.003050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f31f8a2de645568726eeb8b7d0e465)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.005570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.009398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9b475-7436-490f-9b7d-4826e8964c37 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.015416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.016647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.017406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.017874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.019114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.021520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.038267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 985/1978] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:52.038267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.049721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00098f5-6123-49d0-a652-6e3b3e9e784c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.063749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f31f8a2de645568726eeb8b7d0e465', 'request_id': 'req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.070228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:52.071275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f31f8a2de645568726eeb8b7d0e465', 'request_id': 'req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.082820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f31f8a2de645568726eeb8b7d0e465', 'request_id': 'req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.099440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] The token cache is being invalidate because project 30f31f8a2de645568726eeb8b7d0e465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:52.099844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.101056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.102762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 994/1979] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:51 2022] DELETE /identity/v3/projects/30f31f8a2de645568726eeb8b7d0e465 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:52.107045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.107917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:52.144417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.145081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.145364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.145696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.146551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.149805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.187039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 986/1980] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:52 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:52.188360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.191370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:52.212639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f785-37d9-49c9-8c10-70d5bc0bcb5e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.217020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291d01-9bdf-40dc-a6ea-9f4712d2a4dd admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.218671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.219313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.219594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.219920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.220624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.222241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.229721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.230388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.230671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.230955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] PATH_INFO: `/v3/users/0c5bbf67cab04f15b136818c9a1df059` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.232231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5bbf67cab04f15b136818c9a1df059)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.234619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.236951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 995/1981] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:52.238097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.241685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:52.259282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319050-a2a3-4fb1-acb7-35c7b3f9d114 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.265902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.266702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.267000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.267272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.268104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.269735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.276770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:52.283314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 996/1982] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:52.284458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.293471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5bbf67cab04f15b136818c9a1df059'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.298767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e4e20-cca7-47c9-a426-4870fe7e63af admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.304868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f053013-7430-4c84-af27-4d71c0870364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.305834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f053013-7430-4c84-af27-4d71c0870364 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.306120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f053013-7430-4c84-af27-4d71c0870364 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.306399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f053013-7430-4c84-af27-4d71c0870364 admin admin] PATH_INFO: `/v3/projects/005990ebf7a7407f822e89dfccff2a89/users/2bc37b5d7a4749a09f29d651d257fd34/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.309212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5bbf67cab04f15b136818c9a1df059'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.318544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5bbf67cab04f15b136818c9a1df059'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.319463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5bbf67cab04f15b136818c9a1df059'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.323662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f053013-7430-4c84-af27-4d71c0870364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005990ebf7a7407f822e89dfccff2a89, user_id=2bc37b5d7a4749a09f29d651d257fd34, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.326690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f053013-7430-4c84-af27-4d71c0870364 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.330496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5bbf67cab04f15b136818c9a1df059'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:52.354787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 987/1983] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:52 2022] DELETE /identity/v3/users/0c5bbf67cab04f15b136818c9a1df059 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:52.354787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.355063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 997/1984] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:52 2022] PUT /identity/v3/projects/005990ebf7a7407f822e89dfccff2a89/users/2bc37b5d7a4749a09f29d651d257fd34/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:52.356323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:52.358240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.358523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.358793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.392432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] MFA Rules not processed for user `2bc37b5d7a4749a09f29d651d257fd34`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:52.393614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:52.439429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d597-9541-474e-a31a-d84570d00d91 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.445131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.446256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.446541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.447146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] PATH_INFO: `/v3/projects/ba7df8d305bc41b79749c4939304a237/users/ba1b331b6f5c42289e034b6ca4530653/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.464937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7df8d305bc41b79749c4939304a237, user_id=ba1b331b6f5c42289e034b6ca4530653, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.469174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.477627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 998/1985] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:33:52.478816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.480316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:52.493644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 988/1986] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:52 2022] PUT /identity/v3/projects/ba7df8d305bc41b79749c4939304a237/users/ba1b331b6f5c42289e034b6ca4530653/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:52.494990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7319-7740-493f-be23-6ae0cc86f875 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.495250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.507427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:52.582999 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.583987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.584359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.584729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.586065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.589559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.621177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b0b3-42c5-4823-905d-daf4f7ec537a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.624072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 999/1987] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:52 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:52.629329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.692808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:52.709353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa7d7-6085-4007-b5d1-f2b1a3cd68d2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.715697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.716546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.716960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.717252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.717926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.720254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.771550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.775114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.775674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.776197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.783300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.793077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.806388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1000/1988] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:52 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:52.807792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.821637 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 989/1989] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:52.832910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.850328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9d5-ccb8-4fa0-b789-fd853bcbd673 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.867950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.868657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.868968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.869253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] PATH_INFO: `/v3/projects/ba7df8d305bc41b79749c4939304a237/users/ba1b331b6f5c42289e034b6ca4530653/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.871169 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a954-9725-43ea-90d7-f684a46e3ec0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:52.871812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7df8d305bc41b79749c4939304a237, user_id=ba1b331b6f5c42289e034b6ca4530653, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.875218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.883317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fee8c3-7c46-46ae-98d4-5416efaf564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:52.884001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fee8c3-7c46-46ae-98d4-5416efaf564a admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.884285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fee8c3-7c46-46ae-98d4-5416efaf564a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.884567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fee8c3-7c46-46ae-98d4-5416efaf564a admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.885274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fee8c3-7c46-46ae-98d4-5416efaf564a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:52.887019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fee8c3-7c46-46ae-98d4-5416efaf564a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:52.890916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 990/1990] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:52 2022] PUT /identity/v3/projects/ba7df8d305bc41b79749c4939304a237/users/ba1b331b6f5c42289e034b6ca4530653/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:52.892096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:52.894439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:52.913358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1001/1991] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:52.913358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb3e09-8ce3-4119-8427-7560af0ff144 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:52.913358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb3e09-8ce3-4119-8427-7560af0ff144 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:52.913358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb3e09-8ce3-4119-8427-7560af0ff144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:52.951855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2afb3e09-8ce3-4119-8427-7560af0ff144 None None] MFA Rules not processed for user `ba1b331b6f5c42289e034b6ca4530653`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:52.953242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2afb3e09-8ce3-4119-8427-7560af0ff144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.006323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a4e98-9629-486a-a3df-84192f032ee6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.012320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.013049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.014670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.014962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] PATH_INFO: `/v3/projects/4464a44cce1b41cd82b5439049419d2c` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.016207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4464a44cce1b41cd82b5439049419d2c)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.018130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.058933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1002/1992] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:53.060010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb3e09-8ce3-4119-8427-7560af0ff144 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.069425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:53.072193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb3e09-8ce3-4119-8427-7560af0ff144 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.077474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4464a44cce1b41cd82b5439049419d2c', 'request_id': 'req-d62313cb-6590-4b4c-a204-750bba6c12ae'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:53.089672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4464a44cce1b41cd82b5439049419d2c', 'request_id': 'req-d62313cb-6590-4b4c-a204-750bba6c12ae'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:53.103268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4464a44cce1b41cd82b5439049419d2c', 'request_id': 'req-d62313cb-6590-4b4c-a204-750bba6c12ae'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:53.117563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] The token cache is being invalidate because project 4464a44cce1b41cd82b5439049419d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:53.117563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:53.117902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:53.119575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 991/1993] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:52 2022] DELETE /identity/v3/projects/4464a44cce1b41cd82b5439049419d2c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:53.120788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.122437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.148934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2899f-fb9b-4f36-9f72-483d71cb7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.149692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2899f-fb9b-4f36-9f72-483d71cb7eab admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.149976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2899f-fb9b-4f36-9f72-483d71cb7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.150408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2899f-fb9b-4f36-9f72-483d71cb7eab admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.152393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2899f-fb9b-4f36-9f72-483d71cb7eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.155590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2899f-fb9b-4f36-9f72-483d71cb7eab admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.169291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1003/1994] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:53.170486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.170797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.171074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.194015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:53.195344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.200115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62313cb-6590-4b4c-a204-750bba6c12ae admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.204070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b619d-7995-43b4-a811-3582c1bd9fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.210824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b619d-7995-43b4-a811-3582c1bd9fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.211014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1004/1995] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:53.211113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b619d-7995-43b4-a811-3582c1bd9fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.211113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b619d-7995-43b4-a811-3582c1bd9fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.211285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.211285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.212925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ae1b619d-7995-43b4-a811-3582c1bd9fb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.220079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136eb6-5a14-40de-a216-e47ce63802e3 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.232663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36115660-9226-4716-beb5-f02bff307e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.233440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115660-9226-4716-beb5-f02bff307e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.234176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115660-9226-4716-beb5-f02bff307e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.234533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115660-9226-4716-beb5-f02bff307e79 admin admin] PATH_INFO: `/v3/projects/86d3483147ae42b089f2c5df06094092/users/9b8b52d9536e475685442d8b1443b26b/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.256286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115660-9226-4716-beb5-f02bff307e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d3483147ae42b089f2c5df06094092, user_id=9b8b52d9536e475685442d8b1443b26b, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.259356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115660-9226-4716-beb5-f02bff307e79 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.282241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1005/1996] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:53 2022] PUT /identity/v3/projects/86d3483147ae42b089f2c5df06094092/users/9b8b52d9536e475685442d8b1443b26b/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:53.283734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14862f9b-54bb-4ffc-b394-a908c03ea479 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.284030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14862f9b-54bb-4ffc-b394-a908c03ea479 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.284356 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14862f9b-54bb-4ffc-b394-a908c03ea479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.300087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b619d-7995-43b4-a811-3582c1bd9fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.302815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b619d-7995-43b4-a811-3582c1bd9fb2 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.306232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-14862f9b-54bb-4ffc-b394-a908c03ea479 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:53.307540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-14862f9b-54bb-4ffc-b394-a908c03ea479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.313356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 992/1997] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:53.314841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9b53-e42f-4b1e-a55b-88a833dcb8b1 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.315193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9b53-e42f-4b1e-a55b-88a833dcb8b1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.315536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9b53-e42f-4b1e-a55b-88a833dcb8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.338074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:53.351133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4d2b9b53-e42f-4b1e-a55b-88a833dcb8b1 None None] MFA Rules not processed for user `9b8b52d9536e475685442d8b1443b26b`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:53.354491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4d2b9b53-e42f-4b1e-a55b-88a833dcb8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.441589 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1006/1998] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:53.443143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14862f9b-54bb-4ffc-b394-a908c03ea479 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.473559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 993/1999] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:53.474722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9b53-e42f-4b1e-a55b-88a833dcb8b1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.484272 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:53.491348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9b53-e42f-4b1e-a55b-88a833dcb8b1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.500374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.501029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.501447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.501732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.502929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:53.503374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.506223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.538852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 994/2000] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:53.538852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.561190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfa4d-f448-4a8c-a103-ba2303e72475 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.573813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14862f9b-54bb-4ffc-b394-a908c03ea479 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.575046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.575712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.575994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.576282 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.576940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.579781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.588817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.590213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.590497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.590824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.595834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:53.617940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 995/2001] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:53 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:53.619154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.706705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.708683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.714045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ee1c-21bc-4bde-806f-12783f87980a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.720802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.721530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.721877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.722223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.722557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1007/2002] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:53.724077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.734685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.739145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b5d64-caa3-4797-8933-6af0a951691a service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.740403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.749922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.750894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.753027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.753326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.754419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.757302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.800276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1008/2003] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:53 2022] POST /identity/v3/users => generated 298 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:53.805347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.819029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4515fc-aa62-4f3a-91ed-c70bdd588d4f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.820169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 996/2004] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:53 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:53.824421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.890531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:53.900041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:53.901514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:53.903492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:53.903492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:53.903492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:53.908149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:53.933264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1009/2005] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:53.938634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:53.978186 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da99dd-1fd0-45f3-b9f0-e0b90765ee9e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:53.981153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33914b2-3af2-4029-9940-d6268a26fbbe admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.001368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.002115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.002386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.002657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] PATH_INFO: `/v3/projects/47ed579da97b4fab82b34e06de33d570/users/c1ab26251927452bbbe9ddc9ebd808da/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.010287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.010287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.010287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.010287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.011083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.017192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.055331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ed579da97b4fab82b34e06de33d570, user_id=c1ab26251927452bbbe9ddc9ebd808da, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.059751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.080884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 997/2006] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:53 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:54.085102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.087726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1010/2007] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:53 2022] PUT /identity/v3/projects/47ed579da97b4fab82b34e06de33d570/users/c1ab26251927452bbbe9ddc9ebd808da/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:54.091784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.109585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f68464-1560-4e7c-8907-4fe812377aff admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.167328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:54.188795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d687-a068-4df0-9ef1-bca03ac53b84 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.199218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.199821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.200098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.200367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.202921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.203560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.203860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.204131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.208353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.210515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.212485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.218000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.245808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 998/2008] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:54.251564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.263484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1011/2009] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:54.269122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dad04-31ed-47fe-9dc9-323cdc624f4a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.269884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.278210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.278971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.279929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.279929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.280840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.282839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.298927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 999/2010] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:54.299213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d1b76-99da-474e-9708-8a9048c656b1 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.300997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.307693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.308592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.309065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.309668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] PATH_INFO: `/v3/projects/47ed579da97b4fab82b34e06de33d570/users/c1ab26251927452bbbe9ddc9ebd808da/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.313417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ed579da97b4fab82b34e06de33d570, user_id=c1ab26251927452bbbe9ddc9ebd808da, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.319216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.326846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09a383-adf4-4ad4-ba8c-b47a891b8eaa admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.341695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd9d1-50af-40be-9088-8a575fedbf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.342396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd9d1-50af-40be-9088-8a575fedbf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.342692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd9d1-50af-40be-9088-8a575fedbf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.342994 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd9d1-50af-40be-9088-8a575fedbf2e admin admin] PATH_INFO: `/v3/projects/3cf3c4d469b34b27a2a7e7d06a4832a6/users/f33d9ef7eff64eaea10e0dcbebdf20bb/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.353997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1012/2011] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:54 2022] PUT /identity/v3/projects/47ed579da97b4fab82b34e06de33d570/users/c1ab26251927452bbbe9ddc9ebd808da/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:54.356163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.357943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.377895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd9d1-50af-40be-9088-8a575fedbf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf3c4d469b34b27a2a7e7d06a4832a6, user_id=f33d9ef7eff64eaea10e0dcbebdf20bb, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.381368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd9d1-50af-40be-9088-8a575fedbf2e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.401840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1000/2012] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:54 2022] PUT /identity/v3/projects/3cf3c4d469b34b27a2a7e7d06a4832a6/users/f33d9ef7eff64eaea10e0dcbebdf20bb/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:54.403491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ffbb-7bf1-4adb-9545-2a1b705ab557 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.403835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ffbb-7bf1-4adb-9545-2a1b705ab557 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.405456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ffbb-7bf1-4adb-9545-2a1b705ab557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.440367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4a44ffbb-7bf1-4adb-9545-2a1b705ab557 None None] MFA Rules not processed for user `c1ab26251927452bbbe9ddc9ebd808da`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:54.442091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4a44ffbb-7bf1-4adb-9545-2a1b705ab557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.480848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68abef-481b-4494-8f55-22bdb450f222 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.575539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.576902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.577188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.577464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] PATH_INFO: `/v3/users/b9454c91512e423ea71d45ff542fd338` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.579797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9454c91512e423ea71d45ff542fd338)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.582547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.584710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:54.585666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1001/2013] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:54.587001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.587316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.587602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.619358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:54.620828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.632048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1002/2014] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:54.636574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.638046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.653832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f982903-c1a3-42af-8764-6bd5a3fef1a9 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.657242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9454c91512e423ea71d45ff542fd338'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.663445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.664300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.665199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.665199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] PATH_INFO: `/v3/users/22a611fc1bad41c4ac5d0506cf91a336` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.670309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a611fc1bad41c4ac5d0506cf91a336)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.672334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.687936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9454c91512e423ea71d45ff542fd338'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.689090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9454c91512e423ea71d45ff542fd338'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.704825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9454c91512e423ea71d45ff542fd338'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.722569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9454c91512e423ea71d45ff542fd338'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.740512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1013/2015] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:54 2022] DELETE /identity/v3/users/b9454c91512e423ea71d45ff542fd338 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:54.741889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.749070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.752974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a611fc1bad41c4ac5d0506cf91a336'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.771193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a611fc1bad41c4ac5d0506cf91a336'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.784905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a611fc1bad41c4ac5d0506cf91a336'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.785673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a611fc1bad41c4ac5d0506cf91a336'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.790761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:54.797233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a611fc1bad41c4ac5d0506cf91a336'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:54.812189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1003/2016] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:54 2022] DELETE /identity/v3/users/22a611fc1bad41c4ac5d0506cf91a336 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:54.813472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:54.815947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.824113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886675-aace-4183-bfe3-cb137cafeb9e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.895806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910867c4-29a3-4b01-908a-127403955b5f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:54.900056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65decfcd-a649-4e94-b102-efc645253695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.900880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65decfcd-a649-4e94-b102-efc645253695 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.901329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65decfcd-a649-4e94-b102-efc645253695 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.901888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65decfcd-a649-4e94-b102-efc645253695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.902856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee86c-f68f-412d-b931-33fe8caa01cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:54.904370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-65decfcd-a649-4e94-b102-efc645253695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.904510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee86c-f68f-412d-b931-33fe8caa01cc service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:54.904908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee86c-f68f-412d-b931-33fe8caa01cc service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:54.905420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee86c-f68f-412d-b931-33fe8caa01cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:54.907395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b2cee86c-f68f-412d-b931-33fe8caa01cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:54.965329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:54.976349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65decfcd-a649-4e94-b102-efc645253695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.977977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65decfcd-a649-4e94-b102-efc645253695 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:54.984483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee86c-f68f-412d-b931-33fe8caa01cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:54.986268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee86c-f68f-412d-b931-33fe8caa01cc service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:55.000036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1014/2017] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:55.001978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b96d8-e2e8-4ce6-88a6-0d1b3ad94586 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:55.002340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b96d8-e2e8-4ce6-88a6-0d1b3ad94586 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:55.002629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b96d8-e2e8-4ce6-88a6-0d1b3ad94586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:55.005997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1004/2018] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:55.012055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:55.012346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:55.012625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:55.044376 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-fb3b96d8-e2e8-4ce6-88a6-0d1b3ad94586 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:55.047960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-fb3b96d8-e2e8-4ce6-88a6-0d1b3ad94586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:55.048225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:55.049420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:55.065124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1005/2019] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:55.075037 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1015/2020] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:55.091887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:55.095270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:55.108521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b96d8-e2e8-4ce6-88a6-0d1b3ad94586 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:55.129127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2528-1d80-4f61-a901-cd0c55a76708 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:55.130402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b96d8-e2e8-4ce6-88a6-0d1b3ad94586 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:55.136830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:55.140340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:55.140848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:55.141187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:55.141586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:55.141790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:55.141898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:55.143211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:55.166043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:55.167741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:55.182315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:55.187286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:55.193340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1006/2021] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:55.216331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1016/2022] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:56.260347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:56.261855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:56.282256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:56.283800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:56.304173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0fa3-31ff-40ab-bb4d-85ee77a7c5b9 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:56.314164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b64c63-0efd-4a95-897b-c873b36ce0a7 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:56.318927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:56.321340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:56.322315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:56.322776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] PATH_INFO: `/v3/projects/b3e7ad0588044408a65b363b2b25a28e` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:56.325543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e7ad0588044408a65b363b2b25a28e)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:56.329616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:56.330580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:56.331350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:56.331915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:56.332371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] PATH_INFO: `/v3/projects/da2140d405324b83835ea5b942ab3b7f` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:56.336302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2140d405324b83835ea5b942ab3b7f)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:56.339843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:56.427443 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e7ad0588044408a65b363b2b25a28e', 'request_id': 'req-60bac9ef-24ee-4d69-af18-60e59e0e38b1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.441110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e7ad0588044408a65b363b2b25a28e', 'request_id': 'req-60bac9ef-24ee-4d69-af18-60e59e0e38b1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.461505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2140d405324b83835ea5b942ab3b7f', 'request_id': 'req-76f6c83f-9c08-4d80-8730-3d8a9d301938'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.462058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e7ad0588044408a65b363b2b25a28e', 'request_id': 'req-60bac9ef-24ee-4d69-af18-60e59e0e38b1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.470785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2140d405324b83835ea5b942ab3b7f', 'request_id': 'req-76f6c83f-9c08-4d80-8730-3d8a9d301938'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.483152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] The token cache is being invalidate because project b3e7ad0588044408a65b363b2b25a28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:56.483754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.484723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.485953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2140d405324b83835ea5b942ab3b7f', 'request_id': 'req-76f6c83f-9c08-4d80-8730-3d8a9d301938'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.489933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1007/2023] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:56 2022] DELETE /identity/v3/projects/b3e7ad0588044408a65b363b2b25a28e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:56.491434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:56.493692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:56.505821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] The token cache is being invalidate because project da2140d405324b83835ea5b942ab3b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:56.506758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.507664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.513548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1017/2024] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:56 2022] DELETE /identity/v3/projects/da2140d405324b83835ea5b942ab3b7f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:56.524125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:56.525413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:56.531516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:56.607525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac9ef-24ee-4d69-af18-60e59e0e38b1 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:56.722882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6c83f-9c08-4d80-8730-3d8a9d301938 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:56.734625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:56.736496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:56.736870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:56.737249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] PATH_INFO: `/v3/users/ba1b331b6f5c42289e034b6ca4530653` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:56.738721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1b331b6f5c42289e034b6ca4530653)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:56.740932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:56.748288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:56.749101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:56.749592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:56.749959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] PATH_INFO: `/v3/users/7410ebdc84b843cc9a21c95a96543518` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:56.752275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7410ebdc84b843cc9a21c95a96543518)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:56.755405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:56.910434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7410ebdc84b843cc9a21c95a96543518'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.911247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1b331b6f5c42289e034b6ca4530653'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.933208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:56.958218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1b331b6f5c42289e034b6ca4530653'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.958436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7410ebdc84b843cc9a21c95a96543518'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.959809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1b331b6f5c42289e034b6ca4530653'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.973797 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7410ebdc84b843cc9a21c95a96543518'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.974833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7410ebdc84b843cc9a21c95a96543518'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.979882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1b331b6f5c42289e034b6ca4530653'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.990002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7410ebdc84b843cc9a21c95a96543518'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:56.999394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6fbce0ae-4696-4316-b619-6bac39040932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1b331b6f5c42289e034b6ca4530653'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:57.000631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1008/2025] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:56 2022] DELETE /identity/v3/users/7410ebdc84b843cc9a21c95a96543518 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:57.001628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:57.004810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:57.012969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1018/2026] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:33:56 2022] DELETE /identity/v3/users/ba1b331b6f5c42289e034b6ca4530653 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:57.076299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:57.116626 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a83f9-f3d9-4581-bbc7-bddf1c66d0e3 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:57.230227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:57.234454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:57.234927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:57.235758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:57.239928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:57.386881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:57.388423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:57.401816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1009/2027] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:57.500630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:57.501149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:57.501759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:57.574316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] MFA Rules not processed for user `f33d9ef7eff64eaea10e0dcbebdf20bb`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:57.576102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:57.630785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:57.632701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:57.733252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54638f-24fd-453d-a226-eed37f41c9b1 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:57.739792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:57.740699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:57.741562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:57.741562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] PATH_INFO: `/v3/projects/ba7df8d305bc41b79749c4939304a237` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:57.742364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1019/2028] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:57.746558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:57.747723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7df8d305bc41b79749c4939304a237)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:57.748075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:57.751174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:57.785636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e34d3d-8c36-4065-b7a6-bb725836cbd6 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:57.798677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:57.799658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:57.799946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:57.800226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:57.800912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:57.803499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:57.863268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:57.865927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7df8d305bc41b79749c4939304a237', 'request_id': 'req-9df35dae-d8b8-4fe0-9672-46a0234fc627'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:57.877732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7df8d305bc41b79749c4939304a237', 'request_id': 'req-9df35dae-d8b8-4fe0-9672-46a0234fc627'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:57.888485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1020/2029] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:57 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:57.890680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7df8d305bc41b79749c4939304a237', 'request_id': 'req-9df35dae-d8b8-4fe0-9672-46a0234fc627'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:57.898500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:57.919937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] The token cache is being invalidate because project ba7df8d305bc41b79749c4939304a237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:57.920330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:57.921155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9df35dae-d8b8-4fe0-9672-46a0234fc627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:57.925012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1010/2030] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:57 2022] DELETE /identity/v3/projects/ba7df8d305bc41b79749c4939304a237 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:57.930729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80874c-3656-48f4-9194-285cc45b408c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:57.932810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80874c-3656-48f4-9194-285cc45b408c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:57.933208 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80874c-3656-48f4-9194-285cc45b408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:57.976905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-0a80874c-3656-48f4-9194-285cc45b408c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:57.978576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0a80874c-3656-48f4-9194-285cc45b408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:58.084919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1011/2031] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:58.086932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c987-2758-4166-89bc-9a7dc3d088bc None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.087319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c987-2758-4166-89bc-9a7dc3d088bc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.087718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c987-2758-4166-89bc-9a7dc3d088bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.098633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ca4d-1ae2-49f8-854c-f9c0b30102d1 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.111498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.112272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.112501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.112774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.117935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.118966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cae1c987-2758-4166-89bc-9a7dc3d088bc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:58.119883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cae1c987-2758-4166-89bc-9a7dc3d088bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:58.120015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.139360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1012/2032] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:58.142349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c987-2758-4166-89bc-9a7dc3d088bc None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.157872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c987-2758-4166-89bc-9a7dc3d088bc None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.185401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1021/2033] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:57 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:58.191741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.193040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.193893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.195320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.196276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.197156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:58.198010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.212306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.213332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:58.246264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b08b3d-fa9b-46d4-ae47-770579755375 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.247261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1013/2034] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:58.252913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.259936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.260593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.260876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.261152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.261864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.263537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.265238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0453f8f-1477-40ff-bb77-f44eb92c21a7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.279917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.279917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.279917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.279917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.280223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.280223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.287247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1022/2035] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:58.290051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.319590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5656e-3370-4a09-b508-39175a8c6235 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.329821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.330595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.330818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.331097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] PATH_INFO: `/v3/projects/a1fc5cbc3773469bb3e161ec2a13ab03/users/6e871184626d436488d84ada162dc141/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.346266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1014/2036] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:58 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:58.347143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.357109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fc5cbc3773469bb3e161ec2a13ab03, user_id=6e871184626d436488d84ada162dc141, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.360349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.364493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:58.393159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1023/2037] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:58 2022] PUT /identity/v3/projects/a1fc5cbc3773469bb3e161ec2a13ab03/users/6e871184626d436488d84ada162dc141/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:58.398474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.488149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0de0-52d3-4812-8c68-d7ebc556340f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.498235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e64f8-3eaf-46e8-a187-9266c44b3956 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.503533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.504315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.504765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.504765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.505417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.507043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.515500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.516343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.516816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.517675 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.518378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.518656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1024/2038] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:58.524049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.525710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.543713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59686-928f-46ea-9271-1fa6eca084b9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.554305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1015/2039] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:58 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:58.554305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.554305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:58.556851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.557725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.558015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.558295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] PATH_INFO: `/v3/projects/a1fc5cbc3773469bb3e161ec2a13ab03/users/6e871184626d436488d84ada162dc141/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.561372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fc5cbc3773469bb3e161ec2a13ab03, user_id=6e871184626d436488d84ada162dc141, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.565318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.583513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1025/2040] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:58 2022] PUT /identity/v3/projects/a1fc5cbc3773469bb3e161ec2a13ab03/users/6e871184626d436488d84ada162dc141/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:33:58.584505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.588793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:58.599566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:58.657175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53082-1f9d-4419-a1f9-8ba1e13a0688 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.687097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f0cf-1982-46b1-8b97-6b52cda94f14 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:58.692934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.693743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.694022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.694293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] PATH_INFO: `/v3/projects/6d41a217bc214372a290a2b84c05280a` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.695697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d41a217bc214372a290a2b84c05280a)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.698011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.755176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d66b2-331c-4c48-abb1-91e083f91b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:58.755954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d66b2-331c-4c48-abb1-91e083f91b8f service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.756212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d66b2-331c-4c48-abb1-91e083f91b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.757017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d66b2-331c-4c48-abb1-91e083f91b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.759550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-960d66b2-331c-4c48-abb1-91e083f91b8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:58.778500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d41a217bc214372a290a2b84c05280a', 'request_id': 'req-6a734f4b-07d5-4ebf-8271-b52a104379c1'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:58.785094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d41a217bc214372a290a2b84c05280a', 'request_id': 'req-6a734f4b-07d5-4ebf-8271-b52a104379c1'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:58.797086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d41a217bc214372a290a2b84c05280a', 'request_id': 'req-6a734f4b-07d5-4ebf-8271-b52a104379c1'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:58.815075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] The token cache is being invalidate because project 6d41a217bc214372a290a2b84c05280a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:33:58.815977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:58.817899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:33:58.820847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1026/2041] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:33:58 2022] DELETE /identity/v3/projects/6d41a217bc214372a290a2b84c05280a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:58.822164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:58.824634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:58.848873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d66b2-331c-4c48-abb1-91e083f91b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:58.852393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d66b2-331c-4c48-abb1-91e083f91b8f service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:58.866675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:58.879653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1016/2042] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:33:58.881530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a41d-a0f1-4331-88b5-ca2033f37f4d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:58.882372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a41d-a0f1-4331-88b5-ca2033f37f4d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:58.882907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a41d-a0f1-4331-88b5-ca2033f37f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:58.929248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5bb4a41d-a0f1-4331-88b5-ca2033f37f4d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:58.930524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5bb4a41d-a0f1-4331-88b5-ca2033f37f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:59.003126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734f4b-07d5-4ebf-8271-b52a104379c1 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.013711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.014740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.014939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.015191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.015967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.018135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.050129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1027/2043] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:59.051918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.073918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714b9e5-8d22-47f3-9320-a2e1338c5a29 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.092099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.092533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.092887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.093371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.094407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.096020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.100377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1017/2044] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:59.108698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e0aa-480e-4f7b-beb3-ae3566904bc5 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.108983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e0aa-480e-4f7b-beb3-ae3566904bc5 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.109363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e0aa-480e-4f7b-beb3-ae3566904bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.116903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1028/2045] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:59.123038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.146162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f95ded-8bec-4f04-87e5-1f89287fb183 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.151947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-c519e0aa-480e-4f7b-beb3-ae3566904bc5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:59.153411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c519e0aa-480e-4f7b-beb3-ae3566904bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:59.157428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8b51-2e5f-47bf-bc5a-d70b548db175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.158435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8b51-2e5f-47bf-bc5a-d70b548db175 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.159333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8b51-2e5f-47bf-bc5a-d70b548db175 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.160088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8b51-2e5f-47bf-bc5a-d70b548db175 admin admin] PATH_INFO: `/v3/projects/b9d8d47ef2de4c96b760bfcb65364e49/users/36157ee023824fa7b39c8f204e6ee73e/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.175534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1018/2046] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:59.176563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e0aa-480e-4f7b-beb3-ae3566904bc5 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.191993 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8b51-2e5f-47bf-bc5a-d70b548db175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d8d47ef2de4c96b760bfcb65364e49, user_id=36157ee023824fa7b39c8f204e6ee73e, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.197651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e0aa-480e-4f7b-beb3-ae3566904bc5 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.199031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8b51-2e5f-47bf-bc5a-d70b548db175 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.217969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.220134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.220833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.221593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.222759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:33:59.223880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.229613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1029/2047] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:59 2022] PUT /identity/v3/projects/b9d8d47ef2de4c96b760bfcb65364e49/users/36157ee023824fa7b39c8f204e6ee73e/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:59.232716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.233102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.233209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.233456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.259059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:59.261181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:59.262488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1019/2048] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:33:59.263422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.273661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4b96-fdb1-4a09-84c9-2f02170fc2b2 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.282143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:59.353337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1030/2049] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:33:59.363046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.364805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:33:59.425221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.426042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.426884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.429703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.430652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.440388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.508572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5ebad-45a7-4c0e-8e1d-493b68eab0c4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.514106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.514749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.515025 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.515294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.521050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1020/2050] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:33:59 2022] POST /identity/v3/projects => generated 401 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:33:59.525392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.526517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.528124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.548875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1031/2051] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:33:59.639012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f1e4-7f2e-4f28-ae29-c163309833bc admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.647137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.648418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.648908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.649195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.649881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.652268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.695131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1021/2052] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:33:59 2022] POST /identity/v3/users => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:33:59.697244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.711493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7d3f-165d-4cd9-80c5-8d6b0414b69e service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.722086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.723332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.724027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.724491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.725549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.728234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.736248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:59.746454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1032/2053] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:59.747969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.762098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12167e5c-00ef-4a95-bd26-2d9910f4fe69 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.768877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828da29-51f3-447f-9620-8aadb255a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.769706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828da29-51f3-447f-9620-8aadb255a050 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.770086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828da29-51f3-447f-9620-8aadb255a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.770441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828da29-51f3-447f-9620-8aadb255a050 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.771456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828da29-51f3-447f-9620-8aadb255a050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.774558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828da29-51f3-447f-9620-8aadb255a050 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.787843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1022/2054] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:33:59.792485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:33:59.806460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ae5f8-c65d-4298-9c28-6b68e2d15016 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:33:59.812700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:33:59.813564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.813929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.814815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] PATH_INFO: `/v3/projects/718f660b4b0c4eadb6fa502319ab37c4/users/b3da6ca3234d4415be214aa73ceb8094/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.843599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718f660b4b0c4eadb6fa502319ab37c4, user_id=b3da6ca3234d4415be214aa73ceb8094, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:33:59.851820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:33:59.884421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1033/2055] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:33:59 2022] PUT /identity/v3/projects/718f660b4b0c4eadb6fa502319ab37c4/users/b3da6ca3234d4415be214aa73ceb8094/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:33:59.895535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00ddf-348b-430f-8684-16dfc16663ab None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:33:59.896001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00ddf-348b-430f-8684-16dfc16663ab None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:33:59.896682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00ddf-348b-430f-8684-16dfc16663ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:33:59.935516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f4f00ddf-348b-430f-8684-16dfc16663ab None None] MFA Rules not processed for user `b3da6ca3234d4415be214aa73ceb8094`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:33:59.937161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f4f00ddf-348b-430f-8684-16dfc16663ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.029937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1023/2056] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:33:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:00.036098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.150861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e5c1-40ba-4a75-907c-b69e2951e4e0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.157799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b45e-4d95-4cd5-a9ee-9c41b7ce49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.158538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b45e-4d95-4cd5-a9ee-9c41b7ce49f8 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.158914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b45e-4d95-4cd5-a9ee-9c41b7ce49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.159416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b45e-4d95-4cd5-a9ee-9c41b7ce49f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.160261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b45e-4d95-4cd5-a9ee-9c41b7ce49f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.162742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b45e-4d95-4cd5-a9ee-9c41b7ce49f8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.199884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1034/2057] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:00 2022] POST /identity/v3/projects => generated 401 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:00.203984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f00ddf-348b-430f-8684-16dfc16663ab None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.215070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:00.229641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f00ddf-348b-430f-8684-16dfc16663ab None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.273014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513c842-44d4-4e5b-bc4e-2dc8c33e76bc None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.273370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513c842-44d4-4e5b-bc4e-2dc8c33e76bc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.273908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513c842-44d4-4e5b-bc4e-2dc8c33e76bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.312680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-9513c842-44d4-4e5b-bc4e-2dc8c33e76bc None None] MFA Rules not processed for user `6e871184626d436488d84ada162dc141`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:00.314389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9513c842-44d4-4e5b-bc4e-2dc8c33e76bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.354404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.355089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.355435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.355804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.356572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.358652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.387264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1024/2058] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:00 2022] POST /identity/v3/users => generated 307 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:34:00.391526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.412160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee4330-6e43-436d-bf47-aad8405829ba admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.422152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.422995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.423367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.423732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.424731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.428699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.461966 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1035/2059] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:00.463465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a48b-35de-40a3-8a05-8d51c92380d2 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.463758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a48b-35de-40a3-8a05-8d51c92380d2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.464043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a48b-35de-40a3-8a05-8d51c92380d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.466585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1025/2060] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:34:00.471582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.505744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0356b9-de24-4f08-af0d-8deec92b4f69 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.511971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6ce7a48b-35de-40a3-8a05-8d51c92380d2 None None] MFA Rules not processed for user `f33d9ef7eff64eaea10e0dcbebdf20bb`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:00.524438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6ce7a48b-35de-40a3-8a05-8d51c92380d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.534216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166447cf-515d-4bb8-b02e-a87a22c6db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.535011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166447cf-515d-4bb8-b02e-a87a22c6db48 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.535298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166447cf-515d-4bb8-b02e-a87a22c6db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.535580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166447cf-515d-4bb8-b02e-a87a22c6db48 admin admin] PATH_INFO: `/v3/projects/3a3ed5007ddd4c45b9fcda5122c823a3/users/f74742e77c934d80b331148507441664/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.579113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166447cf-515d-4bb8-b02e-a87a22c6db48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3ed5007ddd4c45b9fcda5122c823a3, user_id=f74742e77c934d80b331148507441664, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.581944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166447cf-515d-4bb8-b02e-a87a22c6db48 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.590902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:00.599221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1026/2061] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:00 2022] PUT /identity/v3/projects/3a3ed5007ddd4c45b9fcda5122c823a3/users/f74742e77c934d80b331148507441664/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:00.601042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e82d6e-3494-4df6-ac59-8c2560b113ec None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.601042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e82d6e-3494-4df6-ac59-8c2560b113ec None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.601247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e82d6e-3494-4df6-ac59-8c2560b113ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.623669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1036/2062] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:00.624709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a48b-35de-40a3-8a05-8d51c92380d2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.638756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a48b-35de-40a3-8a05-8d51c92380d2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.640826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-85e82d6e-3494-4df6-ac59-8c2560b113ec None None] MFA Rules not processed for user `36157ee023824fa7b39c8f204e6ee73e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:00.642336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-85e82d6e-3494-4df6-ac59-8c2560b113ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.717648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.719148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.719674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.720772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.721678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.723575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.735581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1037/2063] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:00.736779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.739492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.749605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1027/2064] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:00.749808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e82d6e-3494-4df6-ac59-8c2560b113ec None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.773441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e82d6e-3494-4df6-ac59-8c2560b113ec None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.779655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.780421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.781010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.781360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] PATH_INFO: `/v3/projects/3a3ed5007ddd4c45b9fcda5122c823a3/users/f74742e77c934d80b331148507441664/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.783583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3ed5007ddd4c45b9fcda5122c823a3, user_id=f74742e77c934d80b331148507441664, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.786578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.801281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1028/2065] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:00 2022] PUT /identity/v3/projects/3a3ed5007ddd4c45b9fcda5122c823a3/users/f74742e77c934d80b331148507441664/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:00.802502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:00.808792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.846940 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99ed66-db70-4615-bfe7-a558bb32f6b5 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.853954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:00.872206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843b36-f06f-4da1-83c8-de927cdcde0f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:00.875800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50ace5-121d-46ad-aab6-ed65a271ee94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.876423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50ace5-121d-46ad-aab6-ed65a271ee94 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.876699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50ace5-121d-46ad-aab6-ed65a271ee94 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.876966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50ace5-121d-46ad-aab6-ed65a271ee94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.912714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:00.913829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.914128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.914407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.916265 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.934954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50ace5-121d-46ad-aab6-ed65a271ee94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.937053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50ace5-121d-46ad-aab6-ed65a271ee94 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.939372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:00.947150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1029/2066] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:00.948366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dfa0b-db55-4e7d-a3a6-1259b0677d7e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:00.948704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dfa0b-db55-4e7d-a3a6-1259b0677d7e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:00.949030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dfa0b-db55-4e7d-a3a6-1259b0677d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:00.977493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:00.977678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-de0dfa0b-db55-4e7d-a3a6-1259b0677d7e None None] MFA Rules not processed for user `f74742e77c934d80b331148507441664`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:00.978706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-de0dfa0b-db55-4e7d-a3a6-1259b0677d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:00.979102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:00.989526 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1038/2067] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:01.060330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1030/2068] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:01.073070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:01.074606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:01.087494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b119c-6e25-4f08-a0c8-a0d6d8148df4 service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:01.093685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e21ec2-ac88-4ed5-9eec-b2b09f0db041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:01.094459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21ec2-ac88-4ed5-9eec-b2b09f0db041 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:01.095673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21ec2-ac88-4ed5-9eec-b2b09f0db041 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:01.095673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21ec2-ac88-4ed5-9eec-b2b09f0db041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:01.105929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e21ec2-ac88-4ed5-9eec-b2b09f0db041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:01.112834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e21ec2-ac88-4ed5-9eec-b2b09f0db041 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:01.131327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1039/2069] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:01.243202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dfa0b-db55-4e7d-a3a6-1259b0677d7e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:01.254993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dfa0b-db55-4e7d-a3a6-1259b0677d7e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:01.258942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:01.259826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:01.260113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:01.260391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:01.330057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:01.331546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:01.342313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1031/2070] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:34:02.396131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b691125-6fac-42fb-8114-c61f0f8835d5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:02.396647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b691125-6fac-42fb-8114-c61f0f8835d5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:02.396926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b691125-6fac-42fb-8114-c61f0f8835d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:02.422262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0b691125-6fac-42fb-8114-c61f0f8835d5 None None] MFA Rules not processed for user `36157ee023824fa7b39c8f204e6ee73e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:02.423670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0b691125-6fac-42fb-8114-c61f0f8835d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:02.438363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1040/2071] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:03.372871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:03.374421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:03.401372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:03.492229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5419fe4-8728-406b-b1e5-20b530811cca service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:03.503779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:03.504464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:03.504830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:03.505022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] PATH_INFO: `/v3/users/2bc37b5d7a4749a09f29d651d257fd34` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:03.506442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc37b5d7a4749a09f29d651d257fd34)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:03.513579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:03.607124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc37b5d7a4749a09f29d651d257fd34'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:03.629399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc37b5d7a4749a09f29d651d257fd34'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:03.641767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc37b5d7a4749a09f29d651d257fd34'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:03.642472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc37b5d7a4749a09f29d651d257fd34'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:03.656200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc37b5d7a4749a09f29d651d257fd34'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:03.664064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1032/2072] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:03 2022] DELETE /identity/v3/users/2bc37b5d7a4749a09f29d651d257fd34 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:03.668714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16078b8-e799-47b8-9004-38216c546582 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:03.669199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16078b8-e799-47b8-9004-38216c546582 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:03.669359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16078b8-e799-47b8-9004-38216c546582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:03.695390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a16078b8-e799-47b8-9004-38216c546582 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:03.696669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a16078b8-e799-47b8-9004-38216c546582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:03.762986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1041/2073] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:03.772539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:03.775350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:03.846186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a7ac-02f1-48d1-8ae3-0df36997e9bc admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:03.851505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:03.852265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:03.852611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:03.852924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:03.871298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:03.873472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:03.887591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1033/2074] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:04.380551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16078b8-e799-47b8-9004-38216c546582 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:04.382678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a16078b8-e799-47b8-9004-38216c546582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:04.396880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16078b8-e799-47b8-9004-38216c546582 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:04.401163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:04.402009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:04.402135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:04.402405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] PATH_INFO: `/v3/projects/005990ebf7a7407f822e89dfccff2a89` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:04.403577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=005990ebf7a7407f822e89dfccff2a89)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:04.405553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:04.459508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005990ebf7a7407f822e89dfccff2a89', 'request_id': 'req-a9e6e001-c6ad-4248-b426-f072bc95fb5e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.466432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005990ebf7a7407f822e89dfccff2a89', 'request_id': 'req-a9e6e001-c6ad-4248-b426-f072bc95fb5e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.475087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005990ebf7a7407f822e89dfccff2a89', 'request_id': 'req-a9e6e001-c6ad-4248-b426-f072bc95fb5e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.509738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] The token cache is being invalidate because project 005990ebf7a7407f822e89dfccff2a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:04.510159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.511082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.514665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1042/2075] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:04 2022] DELETE /identity/v3/projects/005990ebf7a7407f822e89dfccff2a89 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:04.518507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:04.541886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b8dca-4710-4aa5-9836-e6cdab83d324 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:04.614147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:04.692436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:04.693423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:04.693874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:04.694376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] PATH_INFO: `/v3/users/9b8b52d9536e475685442d8b1443b26b` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:04.696461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8b52d9536e475685442d8b1443b26b)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:04.699561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:04.790845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8b52d9536e475685442d8b1443b26b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.826669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8b52d9536e475685442d8b1443b26b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.837689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8b52d9536e475685442d8b1443b26b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.838865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8b52d9536e475685442d8b1443b26b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.850657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8b52d9536e475685442d8b1443b26b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:04.865126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1034/2076] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:04 2022] DELETE /identity/v3/users/9b8b52d9536e475685442d8b1443b26b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:05.415898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:05.418953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:05.444648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e001-c6ad-4248-b426-f072bc95fb5e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:05.499676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:05.536642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:05.537332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:05.537597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:05.537874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] PATH_INFO: `/v3/projects/86d3483147ae42b089f2c5df06094092` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:05.539116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d3483147ae42b089f2c5df06094092)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:05.549675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:05.611071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d3483147ae42b089f2c5df06094092', 'request_id': 'req-4f99fce9-2b18-4742-9684-f8e52e054763'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.617896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d3483147ae42b089f2c5df06094092', 'request_id': 'req-4f99fce9-2b18-4742-9684-f8e52e054763'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.627343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d3483147ae42b089f2c5df06094092', 'request_id': 'req-4f99fce9-2b18-4742-9684-f8e52e054763'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.639368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] The token cache is being invalidate because project 86d3483147ae42b089f2c5df06094092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:05.639831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.640735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.643142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1043/2077] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:05 2022] DELETE /identity/v3/projects/86d3483147ae42b089f2c5df06094092 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:05.647574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:05.649167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:05.662871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09387d-527c-4db5-b38b-71f76111c1c9 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:05.733417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:05.734291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:05.734645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:05.734929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] PATH_INFO: `/v3/users/c1ab26251927452bbbe9ddc9ebd808da` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:05.736179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ab26251927452bbbe9ddc9ebd808da)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:05.745984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:05.866819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ab26251927452bbbe9ddc9ebd808da'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.880133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:05.888684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ab26251927452bbbe9ddc9ebd808da'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.898768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ab26251927452bbbe9ddc9ebd808da'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.899870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ab26251927452bbbe9ddc9ebd808da'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.916166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-d81f3146-2512-4cc3-b62a-4b7be98b26d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ab26251927452bbbe9ddc9ebd808da'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:05.928865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1035/2078] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:05 2022] DELETE /identity/v3/users/c1ab26251927452bbbe9ddc9ebd808da => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:05.955489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:05.957286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:05.970973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fce9-2b18-4742-9684-f8e52e054763 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:06.046673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:06.047738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:06.048013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:06.048289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] PATH_INFO: `/v3/users/b3da6ca3234d4415be214aa73ceb8094` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:06.049545 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3da6ca3234d4415be214aa73ceb8094)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:06.051517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:06.118115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3da6ca3234d4415be214aa73ceb8094'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:06.126148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:06.130989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3da6ca3234d4415be214aa73ceb8094'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:06.132494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3da6ca3234d4415be214aa73ceb8094'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:06.141354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3da6ca3234d4415be214aa73ceb8094'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:06.148802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3da6ca3234d4415be214aa73ceb8094'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:06.154726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1044/2079] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:05 2022] DELETE /identity/v3/users/b3da6ca3234d4415be214aa73ceb8094 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:06.159665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:06.159992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:06.160265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:06.180877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:06.182112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:06.251878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1036/2080] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:06.262041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:06.263651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:06.323009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c3e09-836c-48af-a3ae-452ad644a77b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:06.327271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:06.328127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:06.328342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:06.328653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:06.338695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:06.340218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:06.350849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1045/2081] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:06.865506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:06.867102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:06.880162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b413ad1-cec1-4ab2-a0b6-d9538544984e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:06.887908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:06.888768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:06.889200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:06.889630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] PATH_INFO: `/v3/projects/47ed579da97b4fab82b34e06de33d570` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:06.902427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ed579da97b4fab82b34e06de33d570)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:06.908006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:06.924903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:06.926584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:06.955329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a4326-e740-48f3-8a46-5ecbf2c4befe service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:06.965594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:06.966316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:06.966747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:06.967029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] PATH_INFO: `/v3/projects/718f660b4b0c4eadb6fa502319ab37c4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:06.968249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718f660b4b0c4eadb6fa502319ab37c4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:06.983395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:06.984338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ed579da97b4fab82b34e06de33d570', 'request_id': 'req-f0379447-bd77-477d-b3c9-c921e492af05'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:06.993132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ed579da97b4fab82b34e06de33d570', 'request_id': 'req-f0379447-bd77-477d-b3c9-c921e492af05'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.019192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ed579da97b4fab82b34e06de33d570', 'request_id': 'req-f0379447-bd77-477d-b3c9-c921e492af05'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.039866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] The token cache is being invalidate because project 47ed579da97b4fab82b34e06de33d570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:07.040431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.045039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f0379447-bd77-477d-b3c9-c921e492af05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.049008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1037/2082] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:06 2022] DELETE /identity/v3/projects/47ed579da97b4fab82b34e06de33d570 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:07.055400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ccae9-c034-487a-99d5-42a025d82103 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.056218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ccae9-c034-487a-99d5-42a025d82103 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.056647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ccae9-c034-487a-99d5-42a025d82103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.081726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718f660b4b0c4eadb6fa502319ab37c4', 'request_id': 'req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.091441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718f660b4b0c4eadb6fa502319ab37c4', 'request_id': 'req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.091711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-867ccae9-c034-487a-99d5-42a025d82103 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:07.093067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-867ccae9-c034-487a-99d5-42a025d82103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:07.104331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718f660b4b0c4eadb6fa502319ab37c4', 'request_id': 'req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.124239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] The token cache is being invalidate because project 718f660b4b0c4eadb6fa502319ab37c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:07.125175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.126707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.128810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1046/2083] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:06 2022] DELETE /identity/v3/projects/718f660b4b0c4eadb6fa502319ab37c4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:07.132757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.134576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:07.172959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:07.199094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1038/2084] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:07.208056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ca1c-3685-4272-884e-29b6ce7278fb None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.208525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ca1c-3685-4272-884e-29b6ce7278fb None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.208870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ca1c-3685-4272-884e-29b6ce7278fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.229652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-aa35ca1c-3685-4272-884e-29b6ce7278fb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:07.230953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-aa35ca1c-3685-4272-884e-29b6ce7278fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:07.239686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1039/2085] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:07.243970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35ca1c-3685-4272-884e-29b6ce7278fb None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.252119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa87c-cb54-4186-94c9-23e6c2373ef2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:07.260090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:07.260861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.261271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.261613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] PATH_INFO: `/v3/users/f74742e77c934d80b331148507441664` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.262301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35ca1c-3685-4272-884e-29b6ce7278fb None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:07.262931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74742e77c934d80b331148507441664)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:07.266048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:07.268003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:07.274904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:07.275754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.275934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.276198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.277634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:07.277912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:07.280584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:07.305485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1040/2086] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:34:07.313083 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.325446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862a32-97c6-40d9-8ac8-f16576caba29 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:07.332221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:07.333205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.333927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.333927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.334627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:07.337745 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:07.350405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74742e77c934d80b331148507441664'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.375823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74742e77c934d80b331148507441664'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.376557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74742e77c934d80b331148507441664'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.396406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74742e77c934d80b331148507441664'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.396710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1041/2087] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:07 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:07.397777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.402404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:07.410174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74742e77c934d80b331148507441664'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:07.421302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1047/2088] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:07 2022] DELETE /identity/v3/users/f74742e77c934d80b331148507441664 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:07.491478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc917-521b-44c1-9687-8f3ae22e9cfa admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:07.586923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:07.587727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.588103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.588471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.589570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:07.591711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:07.614990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1042/2089] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:07 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:07.619506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.630609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b8ef-f3cd-46d8-afd0-796bb2ad92e9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:07.635383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:07.636110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.636471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.636846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.637638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:07.639336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:07.651874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1048/2090] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:07.657423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.670585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eef7c-2080-4615-b613-a7e7d5bd73cf admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:07.675894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74998406-dc48-4be0-a81a-9ea18538804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:07.676650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74998406-dc48-4be0-a81a-9ea18538804a admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.677029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74998406-dc48-4be0-a81a-9ea18538804a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.677395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74998406-dc48-4be0-a81a-9ea18538804a admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.678217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74998406-dc48-4be0-a81a-9ea18538804a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:07.680418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74998406-dc48-4be0-a81a-9ea18538804a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:07.692895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1043/2091] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:07.697492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.708771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a4a0-08d1-4785-b093-e8133418f104 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:07.715195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:07.715755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.716152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.716431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] PATH_INFO: `/v3/projects/6929a1017f634e35a2f2aa8562218923/users/3624c45fa6fb467eb7d7aaacd3aece97/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.734324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6929a1017f634e35a2f2aa8562218923, user_id=3624c45fa6fb467eb7d7aaacd3aece97, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:07.737237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:07.755693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1049/2092] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:07 2022] PUT /identity/v3/projects/6929a1017f634e35a2f2aa8562218923/users/3624c45fa6fb467eb7d7aaacd3aece97/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:07.763503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:07.763876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:07.764215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:07.801500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] MFA Rules not processed for user `3624c45fa6fb467eb7d7aaacd3aece97`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:07.804715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:07.841196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:07.890389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1044/2093] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:07.903262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.905399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:07.985020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:07.986460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:08.003783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332c25-f043-443f-b77f-9dee23d14529 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.008190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea413210-19aa-45d6-8446-c9933c75d128 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1e0e81d0ee04020b43c28347ef3ab6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.008831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413210-19aa-45d6-8446-c9933c75d128 service glance] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.009115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413210-19aa-45d6-8446-c9933c75d128 service glance] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.009393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413210-19aa-45d6-8446-c9933c75d128 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.038488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea413210-19aa-45d6-8446-c9933c75d128 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.039249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea413210-19aa-45d6-8446-c9933c75d128 service glance] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.056209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1050/2094] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:08.071069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24978b-0ef5-4947-9a5c-cefaa4c916dd None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.081068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.082060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.082366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.083110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] PATH_INFO: `/v3/projects/3a3ed5007ddd4c45b9fcda5122c823a3` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.084714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3ed5007ddd4c45b9fcda5122c823a3)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.087298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.152006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3ed5007ddd4c45b9fcda5122c823a3', 'request_id': 'req-8937dcfa-88c2-42e9-9e1a-2b41814f9730'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:08.159431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3ed5007ddd4c45b9fcda5122c823a3', 'request_id': 'req-8937dcfa-88c2-42e9-9e1a-2b41814f9730'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:08.171980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3ed5007ddd4c45b9fcda5122c823a3', 'request_id': 'req-8937dcfa-88c2-42e9-9e1a-2b41814f9730'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:08.188489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] The token cache is being invalidate because project 3a3ed5007ddd4c45b9fcda5122c823a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:08.188937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:08.189881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8937dcfa-88c2-42e9-9e1a-2b41814f9730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:08.195772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1045/2095] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:07 2022] DELETE /identity/v3/projects/3a3ed5007ddd4c45b9fcda5122c823a3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:08.197719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85f1f2-8f25-48ee-b5ee-56ca2d044e59 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.197719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85f1f2-8f25-48ee-b5ee-56ca2d044e59 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.197719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85f1f2-8f25-48ee-b5ee-56ca2d044e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.227401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ca85f1f2-8f25-48ee-b5ee-56ca2d044e59 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:08.229299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ca85f1f2-8f25-48ee-b5ee-56ca2d044e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:08.270607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:08.328329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1051/2096] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:08.336231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ef71b-e10b-4435-9b72-c8383aebc210 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.336744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ef71b-e10b-4435-9b72-c8383aebc210 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.337491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ef71b-e10b-4435-9b72-c8383aebc210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.366664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7f9ef71b-e10b-4435-9b72-c8383aebc210 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:08.368334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7f9ef71b-e10b-4435-9b72-c8383aebc210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:08.379366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1046/2097] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:08.383389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85f1f2-8f25-48ee-b5ee-56ca2d044e59 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:08.395292 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85f1f2-8f25-48ee-b5ee-56ca2d044e59 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.400995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.402693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.402693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.402693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.403023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:08.403118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.405646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.428151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1052/2098] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:34:08.431228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ef71b-e10b-4435-9b72-c8383aebc210 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:08.443131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ef71b-e10b-4435-9b72-c8383aebc210 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.450883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.452339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.452640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.452972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.454488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.457361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.506336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:08.515347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1047/2099] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:08 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:08.520781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9177bd-a35a-4de5-aab2-da0ae90d4462 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.633034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.633738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.634018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.634287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.634971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.637133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.678157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1053/2100] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:08 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:08.678294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:08.703967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103213b-5d3f-431a-8e33-ae7587f492d6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.721149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.721811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.722097 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.722375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.723085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.724916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.776688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1048/2101] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:34:08.780058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:08.790750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d16bb-5b28-442f-91d6-724c185076cc admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.800015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788382b-af86-4b4e-8d0b-c932d1e70ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.800740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788382b-af86-4b4e-8d0b-c932d1e70ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.801092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788382b-af86-4b4e-8d0b-c932d1e70ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.801449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788382b-af86-4b4e-8d0b-c932d1e70ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.802236 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788382b-af86-4b4e-8d0b-c932d1e70ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.804478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788382b-af86-4b4e-8d0b-c932d1e70ce0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.818248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1054/2102] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:08.822935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:08.837743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6517d-cb9f-4210-870b-d9726cf1d8f7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:08.843984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:08.845066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.845553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.845913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] PATH_INFO: `/v3/projects/21b2d5b191d14007805b9abdfdab9974/users/12c45858d97a4a488868d08171832b17/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.873381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b2d5b191d14007805b9abdfdab9974, user_id=12c45858d97a4a488868d08171832b17, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:08.876752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:08.889848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:08.902131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1049/2103] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:08 2022] PUT /identity/v3/projects/21b2d5b191d14007805b9abdfdab9974/users/12c45858d97a4a488868d08171832b17/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:08.912744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d60d6-c183-435f-b9f2-b2fa0c4bf863 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:08.912934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d60d6-c183-435f-b9f2-b2fa0c4bf863 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:08.913776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d60d6-c183-435f-b9f2-b2fa0c4bf863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:08.967692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-192d60d6-c183-435f-b9f2-b2fa0c4bf863 None None] MFA Rules not processed for user `12c45858d97a4a488868d08171832b17`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:08.969308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-192d60d6-c183-435f-b9f2-b2fa0c4bf863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:09.062058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1055/2104] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:09.067584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:09.145199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f74385-88cc-4a53-a29a-3a0fcb6ca869 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:09.152681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:09.154202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:09.154720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:09.155201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:09.156130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:09.158975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:09.201474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1050/2105] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:09 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:09.205501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d60d6-c183-435f-b9f2-b2fa0c4bf863 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:09.219748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d60d6-c183-435f-b9f2-b2fa0c4bf863 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:09.249547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:09.302729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:09.303551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:09.304335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:09.305199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:09.306027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:09.308171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:09.362998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1056/2106] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:09 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:34:09.369829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:09.392179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30867-87d6-4350-b0af-0f80704217f4 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:09.408421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:09.411759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:09.412160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:09.412535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:09.413394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:09.415180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:09.434400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1051/2107] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:09.439661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:09.468319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76284fc-70e0-4657-8605-baf79fb367ea admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:09.473331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:09.474040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:09.474635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:09.475316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] PATH_INFO: `/v3/projects/c9e935538e364ad2b574089ab909d786/users/98a8d0f778194eed91bfd60b6f3094be/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:09.505312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e935538e364ad2b574089ab909d786, user_id=98a8d0f778194eed91bfd60b6f3094be, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:09.512760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:09.545849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1057/2108] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:09 2022] PUT /identity/v3/projects/c9e935538e364ad2b574089ab909d786/users/98a8d0f778194eed91bfd60b6f3094be/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:09.549792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:09.560583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f33ab-c508-4fc3-9e49-a8611c096d3a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:09.636510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475607a-48a2-4e7f-914c-702db8b79c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:09.637262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475607a-48a2-4e7f-914c-702db8b79c55 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:09.637548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475607a-48a2-4e7f-914c-702db8b79c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:09.637963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475607a-48a2-4e7f-914c-702db8b79c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:09.638665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475607a-48a2-4e7f-914c-702db8b79c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:09.640351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475607a-48a2-4e7f-914c-702db8b79c55 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:09.654245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1052/2109] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:09.656791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:09.672246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e233b6a-6674-4369-b79d-ac19f3099a6c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:09.678948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:09.679758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:09.680111 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:09.680461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] PATH_INFO: `/v3/projects/c9e935538e364ad2b574089ab909d786/users/98a8d0f778194eed91bfd60b6f3094be/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:09.682622 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e935538e364ad2b574089ab909d786, user_id=98a8d0f778194eed91bfd60b6f3094be, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:09.685515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:09.698028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1058/2110] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:09 2022] PUT /identity/v3/projects/c9e935538e364ad2b574089ab909d786/users/98a8d0f778194eed91bfd60b6f3094be/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:09.708214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6770c-8c52-4c96-891a-5541b63d39a8 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:09.708578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6770c-8c52-4c96-891a-5541b63d39a8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:09.708936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6770c-8c52-4c96-891a-5541b63d39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:09.749723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-aaa6770c-8c52-4c96-891a-5541b63d39a8 None None] MFA Rules not processed for user `98a8d0f778194eed91bfd60b6f3094be`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:09.751825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-aaa6770c-8c52-4c96-891a-5541b63d39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:09.876121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:09.896405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1053/2111] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:09.904916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:09.906745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:09.993140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4a65-8aba-4914-a255-1f3e48103f67 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:10.002936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:10.004456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:10.006593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:10.007152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:10.033941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:10.038468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:10.050284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1059/2112] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:10.249450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6770c-8c52-4c96-891a-5541b63d39a8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:10.260825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6770c-8c52-4c96-891a-5541b63d39a8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:10.264920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:10.265549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:10.265829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:10.266347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:10.342916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:10.344712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:10.356265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1054/2113] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:11.819177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:11.821438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:11.931600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d32183-ab04-4b85-8268-cc9b20a271a5 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:11.937582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:11.938329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:11.938524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:11.938804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] PATH_INFO: `/v3/users/900c6f2526c3496e9bc0d1a936bafb94` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:11.940158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900c6f2526c3496e9bc0d1a936bafb94)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:11.942991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:11.971367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:12.004580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900c6f2526c3496e9bc0d1a936bafb94'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.022554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900c6f2526c3496e9bc0d1a936bafb94'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.023406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900c6f2526c3496e9bc0d1a936bafb94'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.032639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900c6f2526c3496e9bc0d1a936bafb94'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.042318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-866b196e-8f11-4414-8f92-f4bb71de1f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900c6f2526c3496e9bc0d1a936bafb94'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.048418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1060/2114] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:11 2022] DELETE /identity/v3/users/900c6f2526c3496e9bc0d1a936bafb94 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:12.247783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:12.261361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59b381-bf3d-47a8-94a2-009a81bc9d0b service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:12.325329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:12.326005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.326389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.326591 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] PATH_INFO: `/v3/projects/caf08919aebf44bfbd92cc49c31ac019` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.327811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf08919aebf44bfbd92cc49c31ac019)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:12.329713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:12.377420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf08919aebf44bfbd92cc49c31ac019', 'request_id': 'req-779553db-d75f-4c87-aa2c-ba8730fa5eff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.383493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf08919aebf44bfbd92cc49c31ac019', 'request_id': 'req-779553db-d75f-4c87-aa2c-ba8730fa5eff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.394324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf08919aebf44bfbd92cc49c31ac019', 'request_id': 'req-779553db-d75f-4c87-aa2c-ba8730fa5eff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.405792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] The token cache is being invalidate because project caf08919aebf44bfbd92cc49c31ac019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:12.406157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.406788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-779553db-d75f-4c87-aa2c-ba8730fa5eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:12.408411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1055/2115] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:12 2022] DELETE /identity/v3/projects/caf08919aebf44bfbd92cc49c31ac019 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:12.414567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dc55-2545-4396-8ee6-a99e4445ce96 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.414841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dc55-2545-4396-8ee6-a99e4445ce96 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.415117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dc55-2545-4396-8ee6-a99e4445ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.440072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6112dc55-2545-4396-8ee6-a99e4445ce96 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:12.442205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6112dc55-2545-4396-8ee6-a99e4445ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:12.535066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1061/2116] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:12.541257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17b543-81ea-4cd4-a84e-de4f04f1fd88 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.541986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17b543-81ea-4cd4-a84e-de4f04f1fd88 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.542405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17b543-81ea-4cd4-a84e-de4f04f1fd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.571032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7a17b543-81ea-4cd4-a84e-de4f04f1fd88 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:12.573757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7a17b543-81ea-4cd4-a84e-de4f04f1fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:12.584372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1056/2117] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:12.589401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dc55-2545-4396-8ee6-a99e4445ce96 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:12.602085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dc55-2545-4396-8ee6-a99e4445ce96 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:12.608889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:12.609566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.609810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.610076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.610802 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:12.611104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:12.612856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:12.625758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1062/2118] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:34:12.630203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17b543-81ea-4cd4-a84e-de4f04f1fd88 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:12.640223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17b543-81ea-4cd4-a84e-de4f04f1fd88 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:12.648573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:12.649701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.650221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.651465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.654359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:12.656884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:12.684330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:12.701660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1057/2119] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:12 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:12.706016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:12.716475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f254-09d0-49d6-8216-2443733a806b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:12.788684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:12.789442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.789791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.790183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.790850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:12.792810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:12.816792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1063/2120] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:12 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:12.821116 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:12.831646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0481d-438d-46c2-84c4-01dc9646b95f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:12.836681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:12.837294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.837573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.837846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.838543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:12.840185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:12.850267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1058/2121] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:12.854662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:12.865201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf12be-7fe2-4653-b29a-d4c29b6544d9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:12.869944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13517-b74f-4cea-affa-657b33998529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:12.870617 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13517-b74f-4cea-affa-657b33998529 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.870901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13517-b74f-4cea-affa-657b33998529 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.871174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13517-b74f-4cea-affa-657b33998529 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.871903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f13517-b74f-4cea-affa-657b33998529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:12.873502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f13517-b74f-4cea-affa-657b33998529 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:12.886320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1064/2122] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:12.890881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:12.901734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314000d-6d77-4de9-850d-2eeccd23a53f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:12.907515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:12.908273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.908552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.908821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] PATH_INFO: `/v3/projects/e2226f3ea72e4edbaada18844c837d2f/users/7658a799ca8d4cc7ad03903cd23794b4/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.926618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2226f3ea72e4edbaada18844c837d2f, user_id=7658a799ca8d4cc7ad03903cd23794b4, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:12.930757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:12.954167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1059/2123] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:12 2022] PUT /identity/v3/projects/e2226f3ea72e4edbaada18844c837d2f/users/7658a799ca8d4cc7ad03903cd23794b4/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:12.961796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:12.962397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:12.962762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:12.971711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:12.984905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:12.986974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:13.055503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1065/2124] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:13.065639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:13.067501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:13.130646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30b7eb-247b-4fee-83b2-ff23cb46b119 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:13.134437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62057678-0c16-450b-ae21-b47384704df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:13.135057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057678-0c16-450b-ae21-b47384704df7 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:13.135336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057678-0c16-450b-ae21-b47384704df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:13.135652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057678-0c16-450b-ae21-b47384704df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:13.144838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62057678-0c16-450b-ae21-b47384704df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:13.146277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62057678-0c16-450b-ae21-b47384704df7 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:13.156260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1060/2125] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:15.655016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:15.657436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:15.672832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43faf-895e-4584-a484-253ca43a82bb None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:15.680568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:15.681284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:15.681659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:15.681975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] PATH_INFO: `/v3/users/12c45858d97a4a488868d08171832b17` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:15.683188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c45858d97a4a488868d08171832b17)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:15.685775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:15.747537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c45858d97a4a488868d08171832b17'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:15.761656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c45858d97a4a488868d08171832b17'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:15.762420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c45858d97a4a488868d08171832b17'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:15.770599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c45858d97a4a488868d08171832b17'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:15.781676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c45858d97a4a488868d08171832b17'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:15.788825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1066/2126] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:15 2022] DELETE /identity/v3/users/12c45858d97a4a488868d08171832b17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:15.793861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:15.794381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:15.795006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:15.817231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:15.818723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:15.887350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1061/2127] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:15.905318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:15.907171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:15.978965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395014b8-d112-4496-89b6-0aa9cb4811f4 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:15.985055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:15.986093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:15.986371 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:15.986917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:16.005830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:16.007466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:16.019547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1067/2128] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:16.444127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:16.445736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:16.460980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340eb1-512d-481d-bf63-d222437932d1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:16.467012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:16.467842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:16.468226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:16.468556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] PATH_INFO: `/v3/projects/21b2d5b191d14007805b9abdfdab9974` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:16.469848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b2d5b191d14007805b9abdfdab9974)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:16.472028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:16.535012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b2d5b191d14007805b9abdfdab9974', 'request_id': 'req-675bba7e-5748-4d83-b77c-0603ca6827e2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.543887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b2d5b191d14007805b9abdfdab9974', 'request_id': 'req-675bba7e-5748-4d83-b77c-0603ca6827e2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.548855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:16.558618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b2d5b191d14007805b9abdfdab9974', 'request_id': 'req-675bba7e-5748-4d83-b77c-0603ca6827e2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.577782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] The token cache is being invalidate because project 21b2d5b191d14007805b9abdfdab9974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:16.577782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.580177 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.584458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1062/2129] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:16 2022] DELETE /identity/v3/projects/21b2d5b191d14007805b9abdfdab9974 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:16.588460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:16.602346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0bf04-a870-428d-9676-c6b098b8b9f5 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:16.629682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:16.691373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:16.692110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:16.692608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:16.693031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] PATH_INFO: `/v3/users/98a8d0f778194eed91bfd60b6f3094be` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:16.694471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a8d0f778194eed91bfd60b6f3094be)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:16.697873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:16.769213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a8d0f778194eed91bfd60b6f3094be'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.785036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a8d0f778194eed91bfd60b6f3094be'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.786066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a8d0f778194eed91bfd60b6f3094be'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.798147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a8d0f778194eed91bfd60b6f3094be'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.808842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-912acd04-d4c0-431b-a367-a5859975555f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a8d0f778194eed91bfd60b6f3094be'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:16.819385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1068/2130] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:16 2022] DELETE /identity/v3/users/98a8d0f778194eed91bfd60b6f3094be => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:17.728586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:17.734043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:17.760998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bba7e-5748-4d83-b77c-0603ca6827e2 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:17.901514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:17.902449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:17.902905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:17.903318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] PATH_INFO: `/v3/projects/c9e935538e364ad2b574089ab909d786` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:17.905085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e935538e364ad2b574089ab909d786)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:17.907548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:17.983392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e935538e364ad2b574089ab909d786', 'request_id': 'req-57d599c1-ad73-42e3-8e8f-e1591c1334ce'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:17.995071 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e935538e364ad2b574089ab909d786', 'request_id': 'req-57d599c1-ad73-42e3-8e8f-e1591c1334ce'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:18.021220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e935538e364ad2b574089ab909d786', 'request_id': 'req-57d599c1-ad73-42e3-8e8f-e1591c1334ce'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:18.043850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] The token cache is being invalidate because project c9e935538e364ad2b574089ab909d786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:18.044398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:18.062485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:18.062485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1063/2131] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:17 2022] DELETE /identity/v3/projects/c9e935538e364ad2b574089ab909d786 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:18.066392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaddf0d-af64-467f-b377-3a5a775dbbf4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.066871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaddf0d-af64-467f-b377-3a5a775dbbf4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.066949 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaddf0d-af64-467f-b377-3a5a775dbbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.071143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:18.074748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:18.100060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-deaddf0d-af64-467f-b377-3a5a775dbbf4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:18.101702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-deaddf0d-af64-467f-b377-3a5a775dbbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:18.214930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d599c1-ad73-42e3-8e8f-e1591c1334ce admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:18.219963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:18.220847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.220847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.221285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.223280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:18.249604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1069/2132] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:18.251530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4128f-f312-4d5b-af0c-924f05668e50 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.251871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4128f-f312-4d5b-af0c-924f05668e50 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.252423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4128f-f312-4d5b-af0c-924f05668e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.284435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:18.292710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-40d4128f-f312-4d5b-af0c-924f05668e50 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:18.295736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-40d4128f-f312-4d5b-af0c-924f05668e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:18.312892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1070/2133] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:18.314079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4128f-f312-4d5b-af0c-924f05668e50 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:18.328920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4128f-f312-4d5b-af0c-924f05668e50 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:18.335900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:18.337461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.337461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.337461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.338747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:18.339222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:18.341156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:18.359798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1071/2134] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:34:18.362863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:18.364841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:18.376175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:18.389778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7290f-bd8b-4fb0-aab8-63cb59bc8093 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:18.396245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1064/2135] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:34:18.399602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:18.400843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.401159 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.401447 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.402122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:18.405117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:18.432233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:18.444031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1072/2136] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:18 2022] POST /identity/v3/projects => generated 355 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:18.448132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:18.469532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce769af-14ed-4a58-ba41-fe6c307270c7 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:18.591313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:18.592613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.593157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.593659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.595844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:18.599020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:18.633242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1065/2137] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:18 2022] POST /identity/v3/users => generated 278 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:18.633713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:18.648192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00e6d-8bca-4b48-985b-82cf5e94882e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:18.653329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:18.653965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.654241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.654510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.655210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:18.657266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:18.675984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1073/2138] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:18.680011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:18.695331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f89c4-c534-4a41-b525-5e6b6d154721 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:18.701850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd348ae-2457-42c2-9d4b-b45da8a31aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:18.702539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd348ae-2457-42c2-9d4b-b45da8a31aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.702861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd348ae-2457-42c2-9d4b-b45da8a31aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.703137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd348ae-2457-42c2-9d4b-b45da8a31aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.703930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd348ae-2457-42c2-9d4b-b45da8a31aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:18.705742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd348ae-2457-42c2-9d4b-b45da8a31aa0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:18.718550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1066/2139] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:18.723602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:18.736140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5abe37-ffbc-4b29-be22-1c4679b22b7e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:18.741018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:18.741776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.741989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.742286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] PATH_INFO: `/v3/projects/3fe69925e2c444fbb423f6afd9206038/users/d37d5f1616c4461490899fc2e9c82501/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.792597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe69925e2c444fbb423f6afd9206038, user_id=d37d5f1616c4461490899fc2e9c82501, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:18.807645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:18.825436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1074/2140] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:18 2022] PUT /identity/v3/projects/3fe69925e2c444fbb423f6afd9206038/users/d37d5f1616c4461490899fc2e9c82501/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:18.836623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f4d4-bb72-41c2-ba34-b1e33c5df6ee None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:18.837179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f4d4-bb72-41c2-ba34-b1e33c5df6ee None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:18.837179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f4d4-bb72-41c2-ba34-b1e33c5df6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:18.871349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-3902f4d4-bb72-41c2-ba34-b1e33c5df6ee None None] MFA Rules not processed for user `d37d5f1616c4461490899fc2e9c82501`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:18.873821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3902f4d4-bb72-41c2-ba34-b1e33c5df6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:18.957835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1067/2141] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:18 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:18.999644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:19.005024 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:19.112700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24848a49-d8d8-4c30-a1cd-3f248eaaf390 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:19.127608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d161cc-3048-4668-8bdf-797bea933aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:19.132176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d161cc-3048-4668-8bdf-797bea933aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:19.132462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d161cc-3048-4668-8bdf-797bea933aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:19.132795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d161cc-3048-4668-8bdf-797bea933aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:19.161146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d161cc-3048-4668-8bdf-797bea933aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:19.168591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d161cc-3048-4668-8bdf-797bea933aa3 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:19.182072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1075/2142] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:19.200008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902f4d4-bb72-41c2-ba34-b1e33c5df6ee None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:19.286440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:19.352346 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:19.352691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:19.352900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:19.369002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902f4d4-bb72-41c2-ba34-b1e33c5df6ee None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:19.393942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:19.394631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:19.394920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:19.398691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] PATH_INFO: `/v3/users/d37d5f1616c4461490899fc2e9c82501` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:19.403318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37d5f1616c4461490899fc2e9c82501)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:19.405387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:19.443090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] MFA Rules not processed for user `7658a799ca8d4cc7ad03903cd23794b4`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:19.445279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:19.530617 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37d5f1616c4461490899fc2e9c82501'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:19.558437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37d5f1616c4461490899fc2e9c82501'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:19.571030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37d5f1616c4461490899fc2e9c82501'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:19.572305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37d5f1616c4461490899fc2e9c82501'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:19.589296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c3ed4e53-8492-4573-8c82-f36df3beb33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37d5f1616c4461490899fc2e9c82501'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:19.602822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1068/2143] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:19 2022] DELETE /identity/v3/users/d37d5f1616c4461490899fc2e9c82501 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:19.605035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:19.605328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:19.605668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:19.637669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1076/2144] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:19.644769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:19.645227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:19.646599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:19.647862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:19.731772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1069/2145] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:19.738027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:19.747673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:19.749596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:19.769571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337068f-4ef5-441f-8b04-92a3484336c4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:19.829497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b50fb-ff21-4de6-af2e-aacba71589af None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:19.833780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:19.834409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:19.834863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:19.835335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:19.843871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:19.848603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:19.853386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:19.890333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1070/2146] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:34:19.892682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e556b-32d3-476e-9e30-b771b1b299a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:19.893539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e556b-32d3-476e-9e30-b771b1b299a1 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:19.893822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e556b-32d3-476e-9e30-b771b1b299a1 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:19.894177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e556b-32d3-476e-9e30-b771b1b299a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:19.985080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e556b-32d3-476e-9e30-b771b1b299a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:19.987310 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e556b-32d3-476e-9e30-b771b1b299a1 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:19.999758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1077/2147] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:20.701715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:20.703356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:20.746879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c01cfe-6c27-43ff-becd-5d04e280efda service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:20.753902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:20.755368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:20.755836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:20.756295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] PATH_INFO: `/v3/projects/3fe69925e2c444fbb423f6afd9206038` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:20.757804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe69925e2c444fbb423f6afd9206038)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:20.760185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:20.882341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe69925e2c444fbb423f6afd9206038', 'request_id': 'req-0cdf7065-7e0e-486b-b837-e5fbba0919b0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:20.892233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe69925e2c444fbb423f6afd9206038', 'request_id': 'req-0cdf7065-7e0e-486b-b837-e5fbba0919b0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:20.907353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe69925e2c444fbb423f6afd9206038', 'request_id': 'req-0cdf7065-7e0e-486b-b837-e5fbba0919b0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:20.926437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] The token cache is being invalidate because project 3fe69925e2c444fbb423f6afd9206038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:20.926762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:20.927501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0cdf7065-7e0e-486b-b837-e5fbba0919b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:20.929357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1071/2148] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:20 2022] DELETE /identity/v3/projects/3fe69925e2c444fbb423f6afd9206038 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:20.934294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8fd37-d2cd-49ff-8c46-c17bbeaa3f3b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:20.934822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8fd37-d2cd-49ff-8c46-c17bbeaa3f3b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:20.934822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8fd37-d2cd-49ff-8c46-c17bbeaa3f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:20.956675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-11f8fd37-d2cd-49ff-8c46-c17bbeaa3f3b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:20.957952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-11f8fd37-d2cd-49ff-8c46-c17bbeaa3f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:21.059167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1078/2149] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:21.068131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4d49-802f-4400-9985-a339a271b2d4 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.068391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4d49-802f-4400-9985-a339a271b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.068659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4d49-802f-4400-9985-a339a271b2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.090925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-623b4d49-802f-4400-9985-a339a271b2d4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:21.092190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-623b4d49-802f-4400-9985-a339a271b2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:21.117502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1072/2150] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:21.122770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8fd37-d2cd-49ff-8c46-c17bbeaa3f3b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:21.143514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8fd37-d2cd-49ff-8c46-c17bbeaa3f3b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:21.166854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:21.168170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.168603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.169024 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.169927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:21.170381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:21.172365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:21.199217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1079/2151] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:34:21.205506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4d49-802f-4400-9985-a339a271b2d4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:21.233065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4d49-802f-4400-9985-a339a271b2d4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:21.254076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:21.255990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.256559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.257139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.264363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:21.266613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:21.344086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1073/2152] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:21 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:21.349136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:21.366278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9f3bc-1613-4374-8e48-fb5ca54ef10b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:21.401650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:21.480637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:21.481685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.482425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.482714 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.484751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:21.487377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:21.533641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1080/2153] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:21 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:34:21.539667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:21.569643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1da50-1c8b-4b53-a231-11cfb9715c21 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:21.587777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:21.589380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.589829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.591145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.592948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:21.602847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:21.632950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1074/2154] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:21.633901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:21.649638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8679f2-60c4-4e5b-93f5-1ce62a45884f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:21.655567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5459c-a558-4040-aa28-3b29a2c7334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:21.656806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5459c-a558-4040-aa28-3b29a2c7334c admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.657500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5459c-a558-4040-aa28-3b29a2c7334c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.657961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5459c-a558-4040-aa28-3b29a2c7334c admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.658857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5459c-a558-4040-aa28-3b29a2c7334c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:21.661525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5459c-a558-4040-aa28-3b29a2c7334c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:21.689069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:21.700659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1081/2155] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:21.708187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058441-4462-44bf-af4c-569629f9e603 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:21.716156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:21.717860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.718874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.719574 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] PATH_INFO: `/v3/projects/26c6033ddbbb4f9fb52626863bd92c62/users/9e2a21caf0894061a35133e3a551dd78/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.743609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c6033ddbbb4f9fb52626863bd92c62, user_id=9e2a21caf0894061a35133e3a551dd78, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:21.747154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:21.775937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1075/2156] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:21 2022] PUT /identity/v3/projects/26c6033ddbbb4f9fb52626863bd92c62/users/9e2a21caf0894061a35133e3a551dd78/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:21.797556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec256be6-f9ef-4949-ac61-171844287add None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:21.798074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec256be6-f9ef-4949-ac61-171844287add None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:21.798533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec256be6-f9ef-4949-ac61-171844287add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:21.854739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ec256be6-f9ef-4949-ac61-171844287add None None] MFA Rules not processed for user `9e2a21caf0894061a35133e3a551dd78`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:21.856303 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ec256be6-f9ef-4949-ac61-171844287add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:21.969493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1082/2157] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:21.979935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:21.981864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:22.050708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024c40b-e0fa-4646-b7e9-205c41b1dfdb admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:22.054730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b154ef-5f4c-477e-b6c5-42b021607241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:22.055373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b154ef-5f4c-477e-b6c5-42b021607241 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:22.055689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b154ef-5f4c-477e-b6c5-42b021607241 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:22.055968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b154ef-5f4c-477e-b6c5-42b021607241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:22.065242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b154ef-5f4c-477e-b6c5-42b021607241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:22.066679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b154ef-5f4c-477e-b6c5-42b021607241 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:22.076809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1076/2158] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:34:22.282148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c2c12-4776-4158-a63d-f6e60ec0010b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:22.282644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c2c12-4776-4158-a63d-f6e60ec0010b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:22.282839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c2c12-4776-4158-a63d-f6e60ec0010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:22.303867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ca0c2c12-4776-4158-a63d-f6e60ec0010b None None] MFA Rules not processed for user `7658a799ca8d4cc7ad03903cd23794b4`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:22.305031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ca0c2c12-4776-4158-a63d-f6e60ec0010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:22.377085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1083/2159] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:23.577762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:23.577762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:23.578174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:23.623309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] MFA Rules not processed for user `9e2a21caf0894061a35133e3a551dd78`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:23.624663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:23.647663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1077/2160] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:27.925030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288feaa-5ca4-434d-a553-f1d641d3687a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:27.925604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288feaa-5ca4-434d-a553-f1d641d3687a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:27.925712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288feaa-5ca4-434d-a553-f1d641d3687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:27.946611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6288feaa-5ca4-434d-a553-f1d641d3687a None None] MFA Rules not processed for user `36157ee023824fa7b39c8f204e6ee73e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:27.948000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6288feaa-5ca4-434d-a553-f1d641d3687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:27.976319 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:28.007697 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1084/2161] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:33.599571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:38.001082 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=11 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:39.623192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:39.625806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:39.709221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6cb9b-6c4d-41f1-ba84-ecddc3f1346c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:39.713860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:39.714551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:39.714835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:39.715114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] PATH_INFO: `/v3/users/3624c45fa6fb467eb7d7aaacd3aece97` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:39.716335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3624c45fa6fb467eb7d7aaacd3aece97)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:39.718446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:39.832127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3624c45fa6fb467eb7d7aaacd3aece97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:39.864244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3624c45fa6fb467eb7d7aaacd3aece97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:39.877456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3624c45fa6fb467eb7d7aaacd3aece97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:39.878471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3624c45fa6fb467eb7d7aaacd3aece97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:39.895216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3624c45fa6fb467eb7d7aaacd3aece97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:39.916938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1078/2162] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:39 2022] DELETE /identity/v3/users/3624c45fa6fb467eb7d7aaacd3aece97 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:39.919518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:39.920728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:39.921250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:39.955092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:39.957387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:40.062438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1085/2163] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:40.073217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:40.074682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:40.147752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308183ab-2298-41ce-b224-007812deee4e admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:40.151718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630556d-8ec4-429b-88db-cb8ae59c5eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:40.152593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630556d-8ec4-429b-88db-cb8ae59c5eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:40.153064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630556d-8ec4-429b-88db-cb8ae59c5eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:40.153525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630556d-8ec4-429b-88db-cb8ae59c5eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:40.166258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630556d-8ec4-429b-88db-cb8ae59c5eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:40.168237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630556d-8ec4-429b-88db-cb8ae59c5eb9 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:40.180048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1079/2164] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:40.965528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:40.967079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:40.982865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd3186-6b4c-482d-b89c-78e3a6194a23 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:40.996463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:40.997713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:40.998270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:40.998841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] PATH_INFO: `/v3/projects/6929a1017f634e35a2f2aa8562218923` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.001156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6929a1017f634e35a2f2aa8562218923)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:41.004766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:41.081086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6929a1017f634e35a2f2aa8562218923', 'request_id': 'req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:41.089131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6929a1017f634e35a2f2aa8562218923', 'request_id': 'req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:41.098401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6929a1017f634e35a2f2aa8562218923', 'request_id': 'req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:41.112273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] The token cache is being invalidate because project 6929a1017f634e35a2f2aa8562218923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:41.112581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:41.113269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-85cc68f0-3499-4aa7-90bd-4b9aca0c5e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:41.115065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1086/2165] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:40 2022] DELETE /identity/v3/projects/6929a1017f634e35a2f2aa8562218923 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:41.120606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2114e-100b-49c3-9fe9-0dbb6772727a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.121126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2114e-100b-49c3-9fe9-0dbb6772727a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.121217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2114e-100b-49c3-9fe9-0dbb6772727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.151606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-51c2114e-100b-49c3-9fe9-0dbb6772727a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:41.152907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-51c2114e-100b-49c3-9fe9-0dbb6772727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:41.172385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:41.254792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1080/2166] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:41.258653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8354fd5-4d9a-418c-9cfa-8249e10de6b6 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.259062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8354fd5-4d9a-418c-9cfa-8249e10de6b6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.259341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8354fd5-4d9a-418c-9cfa-8249e10de6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.289575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f8354fd5-4d9a-418c-9cfa-8249e10de6b6 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:41.290837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f8354fd5-4d9a-418c-9cfa-8249e10de6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:41.299991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1087/2167] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:41.304873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2114e-100b-49c3-9fe9-0dbb6772727a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:41.316065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2114e-100b-49c3-9fe9-0dbb6772727a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:41.321557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:41.322186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.322466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.322741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.323469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:41.323807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:41.325434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:41.338587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1081/2168] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:34:41.343317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8354fd5-4d9a-418c-9cfa-8249e10de6b6 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:41.353781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8354fd5-4d9a-418c-9cfa-8249e10de6b6 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:41.358645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:41.359276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.359558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.359870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.360668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:41.362712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:41.394939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1088/2169] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:41 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:34:41.399229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:41.410457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ecab-41a6-4696-ab48-5219322da023 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:41.504610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:41.505275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.505545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.505816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.506650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:41.508734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:41.534901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1082/2170] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:41 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:41.539538 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:41.556525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f6223-35cd-42b6-8e7f-6a778a1afb0f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:41.563060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:41.563745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.564028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.564378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.565792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:41.567022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:41.582878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1089/2171] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:41.587491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:41.607140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4a8e8-2df9-43ef-ac9e-3e2c55fd3567 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:41.614811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c05b8-ff37-4dba-9ba1-22bdcba9dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:41.615924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c05b8-ff37-4dba-9ba1-22bdcba9dc62 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.616435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c05b8-ff37-4dba-9ba1-22bdcba9dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.616934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c05b8-ff37-4dba-9ba1-22bdcba9dc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.618271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c05b8-ff37-4dba-9ba1-22bdcba9dc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:41.621655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c05b8-ff37-4dba-9ba1-22bdcba9dc62 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:41.641121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1083/2172] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:41.645396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:41.658477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86325-ebb5-4e14-b345-14fdec404e72 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:41.664320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:41.667855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.668290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.668726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] PATH_INFO: `/v3/projects/4c8e2536963e4e5e84c86bbbbed7ee63/users/5e476943aa354644afb057d5e24d9c23/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.693397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8e2536963e4e5e84c86bbbbed7ee63, user_id=5e476943aa354644afb057d5e24d9c23, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:41.696246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:41.711696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1090/2173] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:41 2022] PUT /identity/v3/projects/4c8e2536963e4e5e84c86bbbbed7ee63/users/5e476943aa354644afb057d5e24d9c23/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:41.803890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3167b1-4ce4-4ae7-85c8-51007c6d4f07 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:41.804325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3167b1-4ce4-4ae7-85c8-51007c6d4f07 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:41.804766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3167b1-4ce4-4ae7-85c8-51007c6d4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:41.846955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4c3167b1-4ce4-4ae7-85c8-51007c6d4f07 None None] MFA Rules not processed for user `5e476943aa354644afb057d5e24d9c23`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:41.848547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4c3167b1-4ce4-4ae7-85c8-51007c6d4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:41.933227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1084/2174] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:41.950147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:41.953528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:41.985530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:42.057782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cd907-3cab-4919-865f-b0e5942bef11 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:42.071906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92afa4-c8c4-4d11-b49c-e6176f74c68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:42.071906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92afa4-c8c4-4d11-b49c-e6176f74c68d service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:42.071906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92afa4-c8c4-4d11-b49c-e6176f74c68d service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:42.071906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92afa4-c8c4-4d11-b49c-e6176f74c68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:42.089555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92afa4-c8c4-4d11-b49c-e6176f74c68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:42.095375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92afa4-c8c4-4d11-b49c-e6176f74c68d service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:42.109667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1091/2175] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:44.150243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3f336-790c-45c2-af6f-f7474357927b None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:44.150873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3f336-790c-45c2-af6f-f7474357927b None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:44.151212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3f336-790c-45c2-af6f-f7474357927b None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:44.153901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1085/2176] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:34:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:34:44.179156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:44.179800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:44.179800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:44.203824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] MFA Rules not processed for user `c2fd4c5e6d864ccd864a0114f5f5ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:44.205256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:44.312653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1092/2177] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:34:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:44.324970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3f336-790c-45c2-af6f-f7474357927b None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:44.327392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a0b3f336-790c-45c2-af6f-f7474357927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:44.350870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3f336-790c-45c2-af6f-f7474357927b None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:44.358211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:44.359178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:44.359612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:44.360093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:44.372673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:44.382174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:44.396273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1086/2178] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:45.399019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:45.410162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:45.507573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e39c89-65a6-46fd-8173-234dc6a2b04e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:45.512393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:45.513076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:45.513359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:45.513638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] PATH_INFO: `/v3/users/f33d9ef7eff64eaea10e0dcbebdf20bb` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:45.514952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33d9ef7eff64eaea10e0dcbebdf20bb)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:45.517162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:45.585868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33d9ef7eff64eaea10e0dcbebdf20bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:45.601286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:45.605165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33d9ef7eff64eaea10e0dcbebdf20bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:45.606254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33d9ef7eff64eaea10e0dcbebdf20bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:45.619728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33d9ef7eff64eaea10e0dcbebdf20bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:45.628470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33d9ef7eff64eaea10e0dcbebdf20bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:45.645112 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1093/2179] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:45 2022] DELETE /identity/v3/users/f33d9ef7eff64eaea10e0dcbebdf20bb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:45.887898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:45.905811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:45.924934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51ede-149c-4118-af9c-db5b33b8a56c service placement] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:46.015131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:46.016816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:46.017322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:46.017885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] PATH_INFO: `/v3/projects/3cf3c4d469b34b27a2a7e7d06a4832a6` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:46.020859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf3c4d469b34b27a2a7e7d06a4832a6)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:46.024850 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:46.116684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf3c4d469b34b27a2a7e7d06a4832a6', 'request_id': 'req-8ead40cf-a2aa-4938-919d-4edc0c7552ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.126524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf3c4d469b34b27a2a7e7d06a4832a6', 'request_id': 'req-8ead40cf-a2aa-4938-919d-4edc0c7552ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.136681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf3c4d469b34b27a2a7e7d06a4832a6', 'request_id': 'req-8ead40cf-a2aa-4938-919d-4edc0c7552ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.151254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] The token cache is being invalidate because project 3cf3c4d469b34b27a2a7e7d06a4832a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:46.151556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.152134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.153927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1087/2180] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:45 2022] DELETE /identity/v3/projects/3cf3c4d469b34b27a2a7e7d06a4832a6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:46.158945 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:46.161155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:46.181225 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f01cfb-fc73-4d69-ad59-c901fd5e991e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:46.281830 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:46.282824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:46.283244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:46.283726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] PATH_INFO: `/v3/users/6e871184626d436488d84ada162dc141` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:46.285408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e871184626d436488d84ada162dc141)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:46.287590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:46.358512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e871184626d436488d84ada162dc141'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.375887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e871184626d436488d84ada162dc141'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.377091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e871184626d436488d84ada162dc141'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.392846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e871184626d436488d84ada162dc141'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.403781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6d53df47-854c-469c-a46c-28445d25cf26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e871184626d436488d84ada162dc141'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.412685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1094/2181] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:46 2022] DELETE /identity/v3/users/6e871184626d436488d84ada162dc141 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:46.742185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:46.744674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:46.767784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead40cf-a2aa-4938-919d-4edc0c7552ff admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:46.855805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:46.856467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:46.856750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:46.857028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] PATH_INFO: `/v3/projects/a1fc5cbc3773469bb3e161ec2a13ab03` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:46.858689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fc5cbc3773469bb3e161ec2a13ab03)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:46.861127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:46.921309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:46.934777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fc5cbc3773469bb3e161ec2a13ab03', 'request_id': 'req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.943447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fc5cbc3773469bb3e161ec2a13ab03', 'request_id': 'req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.953930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fc5cbc3773469bb3e161ec2a13ab03', 'request_id': 'req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.967451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] The token cache is being invalidate because project a1fc5cbc3773469bb3e161ec2a13ab03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:46.967786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.968461 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c076ffda-1bd2-4526-88a9-4cebf8ba48e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:46.970005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1088/2182] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:46 2022] DELETE /identity/v3/projects/a1fc5cbc3773469bb3e161ec2a13ab03 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:46.975466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95395c8-ba2b-4b9c-bdad-d4b11586dd81 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:46.975772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95395c8-ba2b-4b9c-bdad-d4b11586dd81 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:46.976045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95395c8-ba2b-4b9c-bdad-d4b11586dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.011656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-b95395c8-ba2b-4b9c-bdad-d4b11586dd81 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:47.013916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b95395c8-ba2b-4b9c-bdad-d4b11586dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:47.095007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:47.112914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1095/2183] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:47.126108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09388-bbf0-4fb4-a7e4-4d5e3953c667 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.126595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09388-bbf0-4fb4-a7e4-4d5e3953c667 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.127091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09388-bbf0-4fb4-a7e4-4d5e3953c667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.161776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-97d09388-bbf0-4fb4-a7e4-4d5e3953c667 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:47.163952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-97d09388-bbf0-4fb4-a7e4-4d5e3953c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:47.179261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1089/2184] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:47.185669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95395c8-ba2b-4b9c-bdad-d4b11586dd81 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:47.197905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95395c8-ba2b-4b9c-bdad-d4b11586dd81 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:47.203094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:47.204305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.204795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.205246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.206474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:47.206967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:47.210004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:47.230924 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1096/2185] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:34:47.236117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09388-bbf0-4fb4-a7e4-4d5e3953c667 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:47.254962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09388-bbf0-4fb4-a7e4-4d5e3953c667 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:47.263737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:47.264732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.265224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.265712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.266970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:47.271029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:47.335185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1090/2186] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:47 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:34:47.336402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:47.347916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7e53-eb29-424a-b122-d8cde5c8b18b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:47.437939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:47.438984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.438984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.439283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.440049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:47.443581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:47.479187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1097/2187] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:47 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:34:47.485400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:47.501599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70520-92f6-468e-b1e0-32400e730933 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:47.506448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:47.507172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.507652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.508120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.509316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:47.510968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:47.522518 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1091/2188] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:47.526998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:47.541071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d8b75-9e93-4360-afcd-da68637f37bc admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:47.546976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fba89-ccd4-4ebe-8d28-ec887e081291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:47.547782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fba89-ccd4-4ebe-8d28-ec887e081291 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.548114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fba89-ccd4-4ebe-8d28-ec887e081291 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.548488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fba89-ccd4-4ebe-8d28-ec887e081291 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.549324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fba89-ccd4-4ebe-8d28-ec887e081291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:47.559527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fba89-ccd4-4ebe-8d28-ec887e081291 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:47.571669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1098/2189] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:34:47.574219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:47.590209 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffb692-2342-4672-86d4-67fd3d9b12c6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:47.598364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:47.599845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.600172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.600531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] PATH_INFO: `/v3/projects/0da4661556654598abac7c48c68dc570/users/8687c8d0e7ab4f37af5c258aae619f90/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.618488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da4661556654598abac7c48c68dc570, user_id=8687c8d0e7ab4f37af5c258aae619f90, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:47.621270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:47.642274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1092/2190] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:47 2022] PUT /identity/v3/projects/0da4661556654598abac7c48c68dc570/users/8687c8d0e7ab4f37af5c258aae619f90/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:47.662436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f404c-cb25-40af-b5e1-18579f5824e3 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.664174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f404c-cb25-40af-b5e1-18579f5824e3 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.664174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f404c-cb25-40af-b5e1-18579f5824e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.716659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e31f404c-cb25-40af-b5e1-18579f5824e3 None None] MFA Rules not processed for user `8687c8d0e7ab4f37af5c258aae619f90`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:47.718591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e31f404c-cb25-40af-b5e1-18579f5824e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:47.833787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1099/2191] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:47.846067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:47.849605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:47.919792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20261e42-7392-476f-b216-24db4f4393f0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:47.924264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753d0e5-29bc-4d4c-8b7d-0f8fac120e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:47.925630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d0e5-29bc-4d4c-8b7d-0f8fac120e9d service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:47.925912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d0e5-29bc-4d4c-8b7d-0f8fac120e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:47.926186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d0e5-29bc-4d4c-8b7d-0f8fac120e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:47.937045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753d0e5-29bc-4d4c-8b7d-0f8fac120e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:47.938880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753d0e5-29bc-4d4c-8b7d-0f8fac120e9d service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:47.962343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1093/2192] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:34:47.972497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f404c-cb25-40af-b5e1-18579f5824e3 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:48.104760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:48.114524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa075cc-fed8-438d-82a4-4d2fee66f87e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:48.114809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa075cc-fed8-438d-82a4-4d2fee66f87e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:48.115268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa075cc-fed8-438d-82a4-4d2fee66f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:48.124427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f404c-cb25-40af-b5e1-18579f5824e3 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:48.140066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:48.140884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:48.141333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:48.141770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] PATH_INFO: `/v3/users/8687c8d0e7ab4f37af5c258aae619f90` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:48.142581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2aa075cc-fed8-438d-82a4-4d2fee66f87e None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:48.143635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8687c8d0e7ab4f37af5c258aae619f90)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:48.144042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2aa075cc-fed8-438d-82a4-4d2fee66f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:48.147360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:48.224196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8687c8d0e7ab4f37af5c258aae619f90'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:48.244220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8687c8d0e7ab4f37af5c258aae619f90'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:48.245012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8687c8d0e7ab4f37af5c258aae619f90'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:48.254388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1094/2193] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:34:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:48.256167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8687c8d0e7ab4f37af5c258aae619f90'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:48.278117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8687c8d0e7ab4f37af5c258aae619f90'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:48.289878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1100/2194] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:47 2022] DELETE /identity/v3/users/8687c8d0e7ab4f37af5c258aae619f90 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:48.297049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:48.298190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:48.298656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:48.333093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:48.335014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:48.338103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:48.340362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:48.340582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:48.489194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf716d8d-75d4-4f1b-a2a5-e97b1d92b282 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:48.497149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:48.498107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:48.498531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:48.499182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:48.502080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:48.508244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1095/2195] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:48.514995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:48.518400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:48.591892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:48.593811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:48.605128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1101/2196] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:34:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:34:48.631439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c9769-4a21-4f97-bb17-fddd86f02f07 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:48.640974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55490b98-72cb-43e8-b678-41571a98373d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:48.642085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490b98-72cb-43e8-b678-41571a98373d service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:48.642541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490b98-72cb-43e8-b678-41571a98373d service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:48.642949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490b98-72cb-43e8-b678-41571a98373d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:48.659008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55490b98-72cb-43e8-b678-41571a98373d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:48.662115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55490b98-72cb-43e8-b678-41571a98373d service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:48.679524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1096/2197] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:34:49.241044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:49.244746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:49.268067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61531be1-59ef-4f7a-be6b-75c6ef111030 service swift] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:49.278798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:49.280512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.280512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.280745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] PATH_INFO: `/v3/projects/0da4661556654598abac7c48c68dc570` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.282110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da4661556654598abac7c48c68dc570)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:49.300070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:49.320592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:49.389532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da4661556654598abac7c48c68dc570', 'request_id': 'req-1c20df3a-c42a-4a87-9263-49d027387489'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:49.402244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da4661556654598abac7c48c68dc570', 'request_id': 'req-1c20df3a-c42a-4a87-9263-49d027387489'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:49.416190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da4661556654598abac7c48c68dc570', 'request_id': 'req-1c20df3a-c42a-4a87-9263-49d027387489'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:49.429543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] The token cache is being invalidate because project 0da4661556654598abac7c48c68dc570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:49.429931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:49.430669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1c20df3a-c42a-4a87-9263-49d027387489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:49.432373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1102/2198] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:49 2022] DELETE /identity/v3/projects/0da4661556654598abac7c48c68dc570 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:49.438339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdf6fb-9f80-42c3-82d1-23513c8bdaac None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.439163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdf6fb-9f80-42c3-82d1-23513c8bdaac None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.439163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdf6fb-9f80-42c3-82d1-23513c8bdaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.471217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ebfdf6fb-9f80-42c3-82d1-23513c8bdaac None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:49.472931 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ebfdf6fb-9f80-42c3-82d1-23513c8bdaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:49.550677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.551234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.551484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.554495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1097/2199] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:49.567151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09169083-1041-479f-b376-56541cc42217 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.567446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09169083-1041-479f-b376-56541cc42217 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.567930 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09169083-1041-479f-b376-56541cc42217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.577957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:49.580095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:49.591375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-09169083-1041-479f-b376-56541cc42217 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:49.592623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-09169083-1041-479f-b376-56541cc42217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:49.603299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1098/2200] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:49.607929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09169083-1041-479f-b376-56541cc42217 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:49.617824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09169083-1041-479f-b376-56541cc42217 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:49.623860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:49.624659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.625004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.625372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.626552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:34:49.626907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:49.628756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:49.642360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1099/2201] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:34:49.646992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:49.655152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1103/2202] 10.222.0.58 () {58 vars in 967 bytes} [Thu Jul 28 06:34:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:49.658506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619c968-81a5-4e89-aebe-cba2006418c0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:49.663580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:49.664541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.664676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.664861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.665526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:49.667468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:49.670620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:49.672044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:49.701870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1100/2203] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:34:49 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:34:49.706120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:49.723389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:49.776272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21616cc5-2ca7-4e38-a17c-07cea4dbb6a9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:49.789960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2119-f964-4c4e-aa6e-07de1ee201fa admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:49.796639 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:49.797988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.798498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.798936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.800113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:49.802448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:49.838622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1101/2204] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:34:49 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:34:49.845576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:49.853333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:49.863135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d0ccf-8aa4-43a8-bf22-64599a73a75c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:49.873667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:49.874727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.875364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.875900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.877559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:49.883554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:49.896472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1102/2205] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:34:49.902014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:49.919442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f1554-6ddb-4ce6-8691-d875dbde8ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:49.920133 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1554-6ddb-4ce6-8691-d875dbde8ea8 service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.920520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1554-6ddb-4ce6-8691-d875dbde8ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.920941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1554-6ddb-4ce6-8691-d875dbde8ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.931573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106bf37-9ee6-4fed-b387-e25d5289dad6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:49.945169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:49.946453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:49.947414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:49.947936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:49.948831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:49.950703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:49.970370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1103/2206] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:34:49.976609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:50.006396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266b3a1-fa67-43b5-95b1-38ec56fe6a2d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:50.014299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:50.015264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:50.015605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:50.015997 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] PATH_INFO: `/v3/projects/35601fae64664637b57407fafaf4315b/users/f6895968464c443184d1babfc8a724d7/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:50.025718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f1554-6ddb-4ce6-8691-d875dbde8ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:50.027735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f1554-6ddb-4ce6-8691-d875dbde8ea8 service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:50.044075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1104/2207] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:34:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:34:50.052609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35601fae64664637b57407fafaf4315b, user_id=f6895968464c443184d1babfc8a724d7, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:50.058358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:50.089267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1104/2208] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:34:49 2022] PUT /identity/v3/projects/35601fae64664637b57407fafaf4315b/users/f6895968464c443184d1babfc8a724d7/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:34:50.104804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473c01f-82e9-4def-b815-41f0894f234c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:50.105184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473c01f-82e9-4def-b815-41f0894f234c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:50.105663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473c01f-82e9-4def-b815-41f0894f234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:50.148644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-9473c01f-82e9-4def-b815-41f0894f234c None None] MFA Rules not processed for user `f6895968464c443184d1babfc8a724d7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:50.150517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9473c01f-82e9-4def-b815-41f0894f234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:50.247943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1105/2209] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:50.256954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:50.259156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:50.372907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50630-714d-441d-99a6-6d2e00c0ab86 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:50.378337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1e0e81d0ee04020b43c28347ef3ab6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:50.379060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:50.379421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:50.379601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:50.389114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06807a-2be5-43a4-9432-0c06b4eb37ab None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:50.389893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06807a-2be5-43a4-9432-0c06b4eb37ab None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:50.390817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06807a-2be5-43a4-9432-0c06b4eb37ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:50.394366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:50.397364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:50.412245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1105/2210] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:50.430742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7a06807a-2be5-43a4-9432-0c06b4eb37ab None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:50.433566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7a06807a-2be5-43a4-9432-0c06b4eb37ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:50.550732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1106/2211] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:34:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:34:50.569477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:50.678723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:50.697799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aebf66-658c-49b4-b686-5d59955f4b83 service glance] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:50.706284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:50.707366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:50.707951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:50.708706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:50.723106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:50.726206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:50.743666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1106/2212] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:34:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:34:51.434508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:51.435008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:51.436146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:51.462905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:51.464439 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:51.472518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1107/2213] 10.222.0.58 () {58 vars in 967 bytes} [Thu Jul 28 06:34:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:51.486301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:51.502126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d922ed-be81-49c1-b906-f02183cb225a service swift] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:51.516526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fabf-fb28-456d-b867-77321ae7a39a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:51.517593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fabf-fb28-456d-b867-77321ae7a39a service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:51.517783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fabf-fb28-456d-b867-77321ae7a39a service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:51.518467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fabf-fb28-456d-b867-77321ae7a39a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:51.542020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fabf-fb28-456d-b867-77321ae7a39a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:51.545515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fabf-fb28-456d-b867-77321ae7a39a service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:51.557692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1107/2214] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:34:53.903805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:53.907646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:53.942750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:54.078354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084f9d8-f1cc-466f-b3f7-e9d4daecc99f None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:54.092595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:54.093656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:54.093990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:54.094341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] PATH_INFO: `/v3/users/5e476943aa354644afb057d5e24d9c23` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:54.098026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e476943aa354644afb057d5e24d9c23)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:54.102094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:54.216246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e476943aa354644afb057d5e24d9c23'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:54.280152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e476943aa354644afb057d5e24d9c23'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:54.281012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e476943aa354644afb057d5e24d9c23'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:54.312113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e476943aa354644afb057d5e24d9c23'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:54.333843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e476943aa354644afb057d5e24d9c23'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:54.357681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1108/2215] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:53 2022] DELETE /identity/v3/users/5e476943aa354644afb057d5e24d9c23 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:54.364662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:54.365594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:54.365594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:54.395993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:54.397166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:54.481957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1108/2216] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:54.498095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:54.500439 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:54.603918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e31ae-3078-45fc-954c-89119bc4e1b0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:54.609285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:54.610234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:54.610700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:54.611140 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:54.627324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:54.630002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:54.645291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1109/2217] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:55.105569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:55.108696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:55.144339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc662aa-8026-4aa7-8fea-1bda516dadf7 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:55.154992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:55.156717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:55.157195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:55.157686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] PATH_INFO: `/v3/projects/4c8e2536963e4e5e84c86bbbbed7ee63` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:55.159690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8e2536963e4e5e84c86bbbbed7ee63)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:55.162977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:55.208512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:55.211767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:55.238370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8e2536963e4e5e84c86bbbbed7ee63', 'request_id': 'req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.240622 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd70f5-d338-478d-991b-f5bf9cabe162 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:55.251338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8e2536963e4e5e84c86bbbbed7ee63', 'request_id': 'req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.275203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8e2536963e4e5e84c86bbbbed7ee63', 'request_id': 'req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.293826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] The token cache is being invalidate because project 4c8e2536963e4e5e84c86bbbbed7ee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:55.294266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.295776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f9fd1592-98e4-4d5c-8d11-dfeaf7679aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.297613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1109/2218] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:55 2022] DELETE /identity/v3/projects/4c8e2536963e4e5e84c86bbbbed7ee63 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:55.301008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:55.353703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:55.354235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:55.354661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:55.355701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] PATH_INFO: `/v3/users/9e2a21caf0894061a35133e3a551dd78` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:55.357874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2a21caf0894061a35133e3a551dd78)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:55.374742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:55.543878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2a21caf0894061a35133e3a551dd78'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.592997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2a21caf0894061a35133e3a551dd78'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.596398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2a21caf0894061a35133e3a551dd78'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.618640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2a21caf0894061a35133e3a551dd78'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.631914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c36e7d5d-01df-4315-9499-d3861533af4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2a21caf0894061a35133e3a551dd78'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:55.646412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1110/2219] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:34:55 2022] DELETE /identity/v3/users/9e2a21caf0894061a35133e3a551dd78 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:55.652647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:55.653638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:55.654144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:55.691932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:55.694246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:55.697854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:55.698240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:55.698657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:55.763670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:55.763670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:55.842614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:55.866448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1110/2220] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:34:55.890788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:55.894689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:55.901472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1111/2221] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:34:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 06:34:55.921249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:55.930417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:56.033234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139f771-7f8f-4add-aeff-ebafd41d15f4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:56.038042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:56.038733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:56.039118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:56.039470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:56.057987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:56.061425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:56.075666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1111/2222] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:34:56.098536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:56.106847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b917e4-c617-4b3d-9971-d9cafdff2290 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:56.117245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01adabf-d9eb-4555-b390-062ac811cdbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:56.118837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01adabf-d9eb-4555-b390-062ac811cdbc service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:56.120029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01adabf-d9eb-4555-b390-062ac811cdbc service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:56.120420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01adabf-d9eb-4555-b390-062ac811cdbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:56.140163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01adabf-d9eb-4555-b390-062ac811cdbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:56.143139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01adabf-d9eb-4555-b390-062ac811cdbc service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:56.162721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1112/2223] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:34:56.435379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:34:56.438384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:56.481753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce4e0c-cb67-4b38-a549-949f0dbeb521 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:34:56.517819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:34:56.525122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:56.525746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:56.526504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] PATH_INFO: `/v3/projects/26c6033ddbbb4f9fb52626863bd92c62` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:56.539575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c6033ddbbb4f9fb52626863bd92c62)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:34:56.548989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:34:56.688967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c6033ddbbb4f9fb52626863bd92c62', 'request_id': 'req-2ec5dacd-0acb-4dee-a52f-7122ccff8736'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:56.699693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c6033ddbbb4f9fb52626863bd92c62', 'request_id': 'req-2ec5dacd-0acb-4dee-a52f-7122ccff8736'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:56.715967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c6033ddbbb4f9fb52626863bd92c62', 'request_id': 'req-2ec5dacd-0acb-4dee-a52f-7122ccff8736'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:56.747141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] The token cache is being invalidate because project 26c6033ddbbb4f9fb52626863bd92c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:34:56.748069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:56.749515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:34:56.753678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1112/2224] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:34:56 2022] DELETE /identity/v3/projects/26c6033ddbbb4f9fb52626863bd92c62 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:34:58.899240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c497-4090-48cc-b82a-908131aebcc2 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:34:58.899905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c497-4090-48cc-b82a-908131aebcc2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:34:58.900822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c497-4090-48cc-b82a-908131aebcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:34:58.991637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1ee5c497-4090-48cc-b82a-908131aebcc2 None None] MFA Rules not processed for user `f25041ca39b84b0b9a3b742d0e43e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:34:58.993171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1ee5c497-4090-48cc-b82a-908131aebcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:34:59.136952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1113/2225] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:34:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:06.741151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:09.120202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=30 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:15.032198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:15.034374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:15.144685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5dacd-0acb-4dee-a52f-7122ccff8736 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:15.152348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:15.153277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:15.153655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:15.154026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] PATH_INFO: `/v3/users/f6895968464c443184d1babfc8a724d7` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:15.155330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6895968464c443184d1babfc8a724d7)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:15.158066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:15.234894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6895968464c443184d1babfc8a724d7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:15.260145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6895968464c443184d1babfc8a724d7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:15.272091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6895968464c443184d1babfc8a724d7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:15.273273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6895968464c443184d1babfc8a724d7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:15.285508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6895968464c443184d1babfc8a724d7'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:15.298402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1113/2226] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:35:15 2022] DELETE /identity/v3/users/f6895968464c443184d1babfc8a724d7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:15.299915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:15.301542 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:15.301812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:15.325760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:15.327141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:15.442070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1114/2227] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:35:15.451294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:15.453160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:15.555249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180720d-76cc-436d-93ff-f10f611c3cc7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:15.563012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157167d-f730-4b5b-8551-0234ed7c7dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:15.563816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157167d-f730-4b5b-8551-0234ed7c7dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:15.564213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157167d-f730-4b5b-8551-0234ed7c7dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:15.564571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157167d-f730-4b5b-8551-0234ed7c7dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:15.575277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157167d-f730-4b5b-8551-0234ed7c7dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:15.576999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157167d-f730-4b5b-8551-0234ed7c7dc3 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:15.592908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1114/2228] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:35:16.214076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:16.216847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:16.256502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d2f18-bb72-496d-80a5-5103b4928c5c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:16.263277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:16.264193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.264983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.265679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] PATH_INFO: `/v3/projects/35601fae64664637b57407fafaf4315b` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.267930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35601fae64664637b57407fafaf4315b)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:16.271572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:16.379732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35601fae64664637b57407fafaf4315b', 'request_id': 'req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:16.397600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35601fae64664637b57407fafaf4315b', 'request_id': 'req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:16.415888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35601fae64664637b57407fafaf4315b', 'request_id': 'req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:16.429700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] The token cache is being invalidate because project 35601fae64664637b57407fafaf4315b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:35:16.430565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:16.432023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ffd1d36-cbb1-49a9-af2a-0eff7fd870e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:16.435969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1115/2229] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:35:16 2022] DELETE /identity/v3/projects/35601fae64664637b57407fafaf4315b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:16.440712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7dc61-508b-45ad-9355-f57033f395b5 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.441564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7dc61-508b-45ad-9355-f57033f395b5 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.441564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7dc61-508b-45ad-9355-f57033f395b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.462256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-56d7dc61-508b-45ad-9355-f57033f395b5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:16.463750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-56d7dc61-508b-45ad-9355-f57033f395b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:16.482251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:16.551570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1115/2230] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:16.560414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59185a-139d-4cb9-90a0-166000d4cfc8 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.560940 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59185a-139d-4cb9-90a0-166000d4cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.561384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59185a-139d-4cb9-90a0-166000d4cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.590461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0c59185a-139d-4cb9-90a0-166000d4cfc8 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:16.592254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0c59185a-139d-4cb9-90a0-166000d4cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:16.602069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1116/2231] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:35:16.606313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7dc61-508b-45ad-9355-f57033f395b5 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:16.623396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7dc61-508b-45ad-9355-f57033f395b5 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:16.629386 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:16.630370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.630663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.630936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.631834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:35:16.632171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:16.633828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:16.657417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1116/2232] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:35:16.659295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59185a-139d-4cb9-90a0-166000d4cfc8 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:16.674364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59185a-139d-4cb9-90a0-166000d4cfc8 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:16.681892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:16.682649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.683308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.683644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.684799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:16.687294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:16.732013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1117/2233] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:35:16 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:35:16.736173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:16.747735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8446f8f-8927-4fe3-8abc-0ad70639cdf7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:16.837025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:16.837966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.838351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.838725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.839670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:16.842178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:16.874964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1117/2234] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:35:16 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:35:16.876399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:16.888178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa201c-c2ba-4f01-b6fb-ed4b157ef82b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:16.894374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:16.895173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.895795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.896081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.896860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:16.898557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:16.912805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1118/2235] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:35:16.914824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:16.930227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e36cc-2270-44e4-963f-67bec97d7b62 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:16.937747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aaf16-54e3-442c-98a2-e746c9bf1a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:16.938604 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aaf16-54e3-442c-98a2-e746c9bf1a42 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.938981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aaf16-54e3-442c-98a2-e746c9bf1a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.939404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aaf16-54e3-442c-98a2-e746c9bf1a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.940334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aaf16-54e3-442c-98a2-e746c9bf1a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:16.942353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aaf16-54e3-442c-98a2-e746c9bf1a42 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:16.954417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1118/2236] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:35:16.958836 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:16.969730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ec16-fb3c-4bf7-9544-83f4c9a56bc7 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:16.977659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:16.978351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:16.978643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:16.978921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] PATH_INFO: `/v3/projects/ce697327b0c948ea818d0a0d90e37d40/users/db12aa6eff2e429db5f77086db318db3/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:16.996981 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce697327b0c948ea818d0a0d90e37d40, user_id=db12aa6eff2e429db5f77086db318db3, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:17.000185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:17.034657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1119/2237] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:35:16 2022] PUT /identity/v3/projects/ce697327b0c948ea818d0a0d90e37d40/users/db12aa6eff2e429db5f77086db318db3/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:17.042135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85885-ee5e-426a-86df-2f20732a6e98 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:17.042392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85885-ee5e-426a-86df-2f20732a6e98 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:17.042616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85885-ee5e-426a-86df-2f20732a6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:17.105697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a6d85885-ee5e-426a-86df-2f20732a6e98 None None] MFA Rules not processed for user `db12aa6eff2e429db5f77086db318db3`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:17.107200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a6d85885-ee5e-426a-86df-2f20732a6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:17.219581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1119/2238] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:17.231259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:17.233424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:17.263506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:17.358152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a594a-fd3b-4fb7-9c66-4bfcc26c2606 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:17.372613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:17.373441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:17.373845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:17.374211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:17.389868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:17.391754 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:17.422327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1120/2239] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:35:20.140340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80ad5-6d3a-4d87-a227-bc1afaac7861 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:20.140866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80ad5-6d3a-4d87-a227-bc1afaac7861 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:20.140968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80ad5-6d3a-4d87-a227-bc1afaac7861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:20.160559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a2d80ad5-6d3a-4d87-a227-bc1afaac7861 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:20.161794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a2d80ad5-6d3a-4d87-a227-bc1afaac7861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:20.175180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:20.224513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1120/2240] 10.222.0.58 () {58 vars in 967 bytes} [Thu Jul 28 06:35:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:20.239217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:20.241194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:20.375407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd0054-05ee-41c9-aadb-fe02a2e26c7d service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:20.381440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:20.382128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:20.382617 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:20.383074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:20.395784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:20.398053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:20.409929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1121/2241] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:35:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:21.248933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb58dd-61aa-4c24-aec1-02c58a7fdd47 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:21.249567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb58dd-61aa-4c24-aec1-02c58a7fdd47 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:21.249567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb58dd-61aa-4c24-aec1-02c58a7fdd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:21.277349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-27fb58dd-61aa-4c24-aec1-02c58a7fdd47 None None] MFA Rules not processed for user `ec303a823f554fae8e5faf6f1e3df154`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:21.278636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-27fb58dd-61aa-4c24-aec1-02c58a7fdd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:21.342968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1121/2242] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:22.616762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:22.618529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:22.694550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddff3b-faa6-4989-a927-282d0f168179 service swift] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:22.699960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:22.700649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:22.700928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:22.701202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] PATH_INFO: `/v3/users/36157ee023824fa7b39c8f204e6ee73e` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:22.702550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36157ee023824fa7b39c8f204e6ee73e)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:22.704571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:22.757799 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36157ee023824fa7b39c8f204e6ee73e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:22.763501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:22.771944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36157ee023824fa7b39c8f204e6ee73e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:22.772585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36157ee023824fa7b39c8f204e6ee73e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:22.781304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36157ee023824fa7b39c8f204e6ee73e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:22.789013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d35f118b-b6e2-4988-bed2-cbed5520c37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36157ee023824fa7b39c8f204e6ee73e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:22.795218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1122/2243] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:35:22 2022] DELETE /identity/v3/users/36157ee023824fa7b39c8f204e6ee73e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:22.994054 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb58dd-61aa-4c24-aec1-02c58a7fdd47 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.008318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb58dd-61aa-4c24-aec1-02c58a7fdd47 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.099657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.102839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.103140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.103423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] PATH_INFO: `/v3/projects/b9d8d47ef2de4c96b760bfcb65364e49` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.106717 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d8d47ef2de4c96b760bfcb65364e49)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.110285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.215510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d8d47ef2de4c96b760bfcb65364e49', 'request_id': 'req-aea086a6-4cfa-4776-92c9-1ceda68a75d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.222348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d8d47ef2de4c96b760bfcb65364e49', 'request_id': 'req-aea086a6-4cfa-4776-92c9-1ceda68a75d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.231271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d8d47ef2de4c96b760bfcb65364e49', 'request_id': 'req-aea086a6-4cfa-4776-92c9-1ceda68a75d0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.242891 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:23.254550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] The token cache is being invalidate because project b9d8d47ef2de4c96b760bfcb65364e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:35:23.255138 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.256421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.258870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1122/2244] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:35:22 2022] DELETE /identity/v3/projects/b9d8d47ef2de4c96b760bfcb65364e49 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:23.265397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127294d-765e-4e5c-b14e-d440ba286e5a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.265990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127294d-765e-4e5c-b14e-d440ba286e5a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.266364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127294d-765e-4e5c-b14e-d440ba286e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.289081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2127294d-765e-4e5c-b14e-d440ba286e5a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:23.290300 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2127294d-765e-4e5c-b14e-d440ba286e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:23.339155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.340785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:23.398365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1123/2245] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:23.408608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecae6f-b823-4198-ae4a-2e46fe92f9c5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.408906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecae6f-b823-4198-ae4a-2e46fe92f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.409318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecae6f-b823-4198-ae4a-2e46fe92f9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.421828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea086a6-4cfa-4776-92c9-1ceda68a75d0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.432379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.433096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.433664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.435731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] PATH_INFO: `/v3/users/db12aa6eff2e429db5f77086db318db3` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.437343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db12aa6eff2e429db5f77086db318db3)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.438071 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4fecae6f-b823-4198-ae4a-2e46fe92f9c5 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:23.439325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4fecae6f-b823-4198-ae4a-2e46fe92f9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:23.439719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.448575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1124/2246] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:23.452760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecae6f-b823-4198-ae4a-2e46fe92f9c5 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.462262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecae6f-b823-4198-ae4a-2e46fe92f9c5 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.467950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.468630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.468875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.469141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.469850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:35:23.470189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.472075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.488559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1125/2247] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:35:23.492648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.503864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07401f-51e9-4baa-95ee-3b0b09eae1b5 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.509130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.509889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.510166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.510427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.511174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.512096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db12aa6eff2e429db5f77086db318db3'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.513275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.526669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db12aa6eff2e429db5f77086db318db3'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.539978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db12aa6eff2e429db5f77086db318db3'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.540686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db12aa6eff2e429db5f77086db318db3'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.548003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1126/2248] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:35:23 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:35:23.549238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.551582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:23.552928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-018d1f68-48b0-4037-ae9e-6cfbbaf35c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db12aa6eff2e429db5f77086db318db3'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:23.560523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1123/2249] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:35:23 2022] DELETE /identity/v3/users/db12aa6eff2e429db5f77086db318db3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:23.564653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.565142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.565519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.586120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:23.588297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:23.631908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434f379-c305-4e64-bf13-e6cf0e21ec61 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.658747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1124/2250] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:23.665520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.666965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:23.679417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:23.700862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:23.714507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.715429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.715887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.716309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.717149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.719486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.744586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f104b-39c3-4207-9ddd-1736049b16b6 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.745033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1127/2251] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:35:23 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:35:23.748819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.749306 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.749517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.749795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.750076 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.760456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1fd96-a90c-4c36-a465-1436ce0dfcb6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.762381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.763866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.765875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.766503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.766781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.767054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.767783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.769503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.774250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1125/2252] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:35:23.783103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1128/2253] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:35:23.784685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.796021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32e011-5053-4acd-8edb-0850934a4b5f service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.800904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384e3a3-4ea0-4145-9bd1-b768c4a70793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.801529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e3a3-4ea0-4145-9bd1-b768c4a70793 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.801808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e3a3-4ea0-4145-9bd1-b768c4a70793 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.802082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e3a3-4ea0-4145-9bd1-b768c4a70793 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.802798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384e3a3-4ea0-4145-9bd1-b768c4a70793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.804452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384e3a3-4ea0-4145-9bd1-b768c4a70793 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.818926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1126/2254] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:35:23.821990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:23.833390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087274-ca10-4812-9ac4-f1cf1e812bfa admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:23.841470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:23.843415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.843941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.844472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] PATH_INFO: `/v3/projects/6fff0fea49624131bec69b4e5f4355f8/users/0df7433fd9234205b908d50ae3fe75b6/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.866614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fff0fea49624131bec69b4e5f4355f8, user_id=0df7433fd9234205b908d50ae3fe75b6, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:23.870492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:23.886119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1129/2255] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:35:23 2022] PUT /identity/v3/projects/6fff0fea49624131bec69b4e5f4355f8/users/0df7433fd9234205b908d50ae3fe75b6/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:35:23.896922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:23.897205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:23.897765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:23.929600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] MFA Rules not processed for user `0df7433fd9234205b908d50ae3fe75b6`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:23.931749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.006547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1127/2256] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:24.026973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.030873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.102181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.103944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.136804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65576-76ad-4d03-bbc4-1e7581e700fb admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.140672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.141308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.141590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.141865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.151645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.153693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.164652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1130/2257] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:35:24.182309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1675-604a-48be-9e44-b5091d5753f7 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.189559 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.190528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.190936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.191305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] PATH_INFO: `/v3/projects/ce697327b0c948ea818d0a0d90e37d40` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.192644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce697327b0c948ea818d0a0d90e37d40)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.194715 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.195273 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.206576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd77afa-93ed-4e2d-b0d1-281c1dddd6f2 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.211400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.212085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.212384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.212660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] PATH_INFO: `/v3/users/0df7433fd9234205b908d50ae3fe75b6` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.213866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df7433fd9234205b908d50ae3fe75b6)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.215833 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.241766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:24.251928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce697327b0c948ea818d0a0d90e37d40', 'request_id': 'req-6adbaaad-92c4-424e-be40-42258947d8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.259600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce697327b0c948ea818d0a0d90e37d40', 'request_id': 'req-6adbaaad-92c4-424e-be40-42258947d8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.268868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df7433fd9234205b908d50ae3fe75b6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.271543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce697327b0c948ea818d0a0d90e37d40', 'request_id': 'req-6adbaaad-92c4-424e-be40-42258947d8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.284923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] The token cache is being invalidate because project ce697327b0c948ea818d0a0d90e37d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:35:24.285139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.286167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-6adbaaad-92c4-424e-be40-42258947d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.288022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1128/2258] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:35:24 2022] DELETE /identity/v3/projects/ce697327b0c948ea818d0a0d90e37d40 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:35:24.292210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df7433fd9234205b908d50ae3fe75b6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.293043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da000-f512-4d41-87ec-cccee6a919d3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.293325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df7433fd9234205b908d50ae3fe75b6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.293466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da000-f512-4d41-87ec-cccee6a919d3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.293823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da000-f512-4d41-87ec-cccee6a919d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.309962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df7433fd9234205b908d50ae3fe75b6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.319850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c2c6560b-3f76-4ed2-bbc6-a41852d476ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df7433fd9234205b908d50ae3fe75b6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:24.320169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b02da000-f512-4d41-87ec-cccee6a919d3 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:24.321462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b02da000-f512-4d41-87ec-cccee6a919d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.328348 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1131/2259] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:35:24 2022] DELETE /identity/v3/users/0df7433fd9234205b908d50ae3fe75b6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:24.336967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.337446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.337796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.366922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:24.380248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:24.382927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.410274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1129/2260] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:24.417733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722382ec-cd9a-4aa2-a950-3f6554c40f9f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.418173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722382ec-cd9a-4aa2-a950-3f6554c40f9f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.418569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722382ec-cd9a-4aa2-a950-3f6554c40f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.441870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-722382ec-cd9a-4aa2-a950-3f6554c40f9f None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:24.443086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-722382ec-cd9a-4aa2-a950-3f6554c40f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.451385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1132/2261] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:24.461384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.463282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.526788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1130/2262] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:35:24.531217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722382ec-cd9a-4aa2-a950-3f6554c40f9f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.540730 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722382ec-cd9a-4aa2-a950-3f6554c40f9f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.546517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.547222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.547563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.547941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.548695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:35:24.549003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcde41f-7d7a-4cb1-89f5-fd84219dabc2 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.549133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.550856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.553387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.554209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.554644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.555074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.565458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1131/2263] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:35:24.566149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.567798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.572067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.579143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1133/2264] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:35:24.585824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b9c0c-6a40-42e3-8fdc-13fa7a2ed8a3 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.591829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.593002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.593002 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.593207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.594091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.596728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.649394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1132/2265] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:35:24 2022] POST /identity/v3/projects => generated 361 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:35:24.650691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.661189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37a5b-2566-4edb-b879-32fd9305e5ae service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.727277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.728586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.728944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.729738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.730459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.733743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.773251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1134/2266] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:35:24 2022] POST /identity/v3/users => generated 281 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:35:24.777419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.796991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbaf38-2fc0-4137-8efd-82f0e019af65 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.802927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.803560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.803944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.804219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.804920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.806529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.819303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1133/2267] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:35:24.823259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.834072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65f240-9b4f-4bf3-9af5-b6f696d2cb41 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.838761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.839389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.839700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.839976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.840674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.842304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.856114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1135/2268] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:35:24.857542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.871653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbed4-0bec-4701-9b96-c30c11a94076 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.877900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e926a5-f0e9-44bd-884c-28ae1c0e7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:24.878721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e926a5-f0e9-44bd-884c-28ae1c0e7e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.879000 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e926a5-f0e9-44bd-884c-28ae1c0e7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:24.879822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e926a5-f0e9-44bd-884c-28ae1c0e7e3b admin admin] PATH_INFO: `/v3/projects/0183e60f976c41d4b1c3e3cd352b5b5a/users/c34116c275fc4c469bdca8c70f81f7b5/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:24.897086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e926a5-f0e9-44bd-884c-28ae1c0e7e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0183e60f976c41d4b1c3e3cd352b5b5a, user_id=c34116c275fc4c469bdca8c70f81f7b5, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:24.899840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e926a5-f0e9-44bd-884c-28ae1c0e7e3b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:24.914541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:24.917422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1134/2269] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:35:24 2022] PUT /identity/v3/projects/0183e60f976c41d4b1c3e3cd352b5b5a/users/c34116c275fc4c469bdca8c70f81f7b5/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:35:24.917422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:24.918055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:24.973174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76eb8-232a-489a-80e8-48ea851d6fa6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:24.999318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:24.999600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.000160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.016173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:25.031499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] MFA Rules not processed for user `c34116c275fc4c469bdca8c70f81f7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:25.032751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:25.061954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.062740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.063019 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.063290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] PATH_INFO: `/v3/projects/6fff0fea49624131bec69b4e5f4355f8` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.064515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fff0fea49624131bec69b4e5f4355f8)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.066616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.112500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1135/2270] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:25.126048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:25.128036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:25.142881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fff0fea49624131bec69b4e5f4355f8', 'request_id': 'req-96975380-6c3e-45be-8349-f78ea508a302'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:25.157307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fff0fea49624131bec69b4e5f4355f8', 'request_id': 'req-96975380-6c3e-45be-8349-f78ea508a302'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:25.172209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fff0fea49624131bec69b4e5f4355f8', 'request_id': 'req-96975380-6c3e-45be-8349-f78ea508a302'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:25.193491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] The token cache is being invalidate because project 6fff0fea49624131bec69b4e5f4355f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:35:25.193784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:25.194463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-96975380-6c3e-45be-8349-f78ea508a302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:25.196189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1136/2271] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:35:24 2022] DELETE /identity/v3/projects/6fff0fea49624131bec69b4e5f4355f8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:35:25.201192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8275-a3cb-4161-9205-291f3ff19cfe None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.201562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8275-a3cb-4161-9205-291f3ff19cfe None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.201903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8275-a3cb-4161-9205-291f3ff19cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.210933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d04f9b-6689-4673-9804-04d208ab17a9 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:25.225367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e73c8275-a3cb-4161-9205-291f3ff19cfe None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:25.226758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e73c8275-a3cb-4161-9205-291f3ff19cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:25.308706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.309725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.310004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.310275 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.312243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:25.332881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1137/2272] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:35:25.341612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4e4c0-b427-45dd-8256-fc2c9fd92c92 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.341943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4e4c0-b427-45dd-8256-fc2c9fd92c92 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.342177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4e4c0-b427-45dd-8256-fc2c9fd92c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.362667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-c7d4e4c0-b427-45dd-8256-fc2c9fd92c92 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:25.363914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c7d4e4c0-b427-45dd-8256-fc2c9fd92c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:25.373311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1138/2273] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:35:25.377276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4e4c0-b427-45dd-8256-fc2c9fd92c92 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:25.387423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4e4c0-b427-45dd-8256-fc2c9fd92c92 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:25.391037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.393282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.393542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.394456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.394942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.395544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.396583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:35:25.396919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.398630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.403366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:25.410429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1136/2274] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:35:25.415576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1139/2275] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:35:25.416791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:25.431432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f76c06-cc96-4b53-91a4-35220730f60d service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:25.444502 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.445766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.446109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.446790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.447781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.451212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.531695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1137/2276] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:35:25 2022] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:35:25.533077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:25.548359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941b14a-bf06-4203-ab55-3a7020c4a7a0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:25.602728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:25.631076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.631938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.632290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.632632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.633516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.635758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.663983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1140/2277] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:35:25 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:35:25.734947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:25.746810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46cb51-224f-40ea-9cf1-5dd411973e31 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:25.751758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.752465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.752863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.753527 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.754318 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.756175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.768618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1138/2278] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:35:25.773887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:25.784152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c87b57-ed5b-440b-871b-c112e776f759 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:25.793187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d6bd3-8148-4ec2-865a-b7dee6d083c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.793834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6bd3-8148-4ec2-865a-b7dee6d083c6 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.794116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6bd3-8148-4ec2-865a-b7dee6d083c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.796812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6bd3-8148-4ec2-865a-b7dee6d083c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.796812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d6bd3-8148-4ec2-865a-b7dee6d083c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.796812 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d6bd3-8148-4ec2-865a-b7dee6d083c6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.810522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1141/2279] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:35:25.813694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:25.824622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c44116-e811-47c9-afb3-c166736c8f9e admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:25.830081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:25.830815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.831096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.831420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] PATH_INFO: `/v3/projects/0c0ba6e940bc4f74a12b58c048fbcd9d/users/803453f06b1943adac4e6df88a1a75cc/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.846791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0ba6e940bc4f74a12b58c048fbcd9d, user_id=803453f06b1943adac4e6df88a1a75cc, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:25.849636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:25.865724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1139/2280] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:35:25 2022] PUT /identity/v3/projects/0c0ba6e940bc4f74a12b58c048fbcd9d/users/803453f06b1943adac4e6df88a1a75cc/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:25.875994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825173b4-51c3-4bdf-aa50-4d7ae89a8ba4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:25.876284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825173b4-51c3-4bdf-aa50-4d7ae89a8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:25.876595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825173b4-51c3-4bdf-aa50-4d7ae89a8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:25.917250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-825173b4-51c3-4bdf-aa50-4d7ae89a8ba4 None None] MFA Rules not processed for user `803453f06b1943adac4e6df88a1a75cc`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:25.918557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-825173b4-51c3-4bdf-aa50-4d7ae89a8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:25.990913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1142/2281] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:26.003293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:26.005477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:26.075650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43375a0-f331-4fd5-a265-1d8e07e85f93 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:26.079710 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cc568-a6a0-49ad-a680-bcfb5b80202e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:26.080449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc568-a6a0-49ad-a680-bcfb5b80202e service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:26.080794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc568-a6a0-49ad-a680-bcfb5b80202e service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:26.081131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc568-a6a0-49ad-a680-bcfb5b80202e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:26.090290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cc568-a6a0-49ad-a680-bcfb5b80202e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:26.091753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cc568-a6a0-49ad-a680-bcfb5b80202e service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:26.101519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1140/2282] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:35:31.196935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825173b4-51c3-4bdf-aa50-4d7ae89a8ba4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:31.270576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825173b4-51c3-4bdf-aa50-4d7ae89a8ba4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:31.276255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:31.276908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:31.277185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:31.277455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] PATH_INFO: `/v3/users/803453f06b1943adac4e6df88a1a75cc` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:31.278771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803453f06b1943adac4e6df88a1a75cc)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:31.281052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:31.329719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803453f06b1943adac4e6df88a1a75cc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.331603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:31.343536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803453f06b1943adac4e6df88a1a75cc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.344261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803453f06b1943adac4e6df88a1a75cc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.352396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803453f06b1943adac4e6df88a1a75cc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.359229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803453f06b1943adac4e6df88a1a75cc'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.365632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1143/2283] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:35:31 2022] DELETE /identity/v3/users/803453f06b1943adac4e6df88a1a75cc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:31.370284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:31.370769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:31.370864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:31.391287 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:31.392612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:31.460075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1141/2284] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:31.469880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:31.471430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:31.529933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b21de6-141c-4742-9d23-b88b41c54c73 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:31.534178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9f60-b3e2-44bd-8eca-e699c8fbc118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:31.534897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9f60-b3e2-44bd-8eca-e699c8fbc118 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:31.535177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9f60-b3e2-44bd-8eca-e699c8fbc118 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:31.535433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9f60-b3e2-44bd-8eca-e699c8fbc118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:31.545547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9f60-b3e2-44bd-8eca-e699c8fbc118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:31.547007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9f60-b3e2-44bd-8eca-e699c8fbc118 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:31.556952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1144/2285] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:35:31.841178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:31.842688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:31.855872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7e9f6-a9d4-42a0-b689-bd0512c1a11a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:31.860797 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:31.861563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:31.861861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:31.862173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] PATH_INFO: `/v3/projects/0c0ba6e940bc4f74a12b58c048fbcd9d` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:31.863926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0ba6e940bc4f74a12b58c048fbcd9d)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:31.866143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:31.911192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:31.918569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0ba6e940bc4f74a12b58c048fbcd9d', 'request_id': 'req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.925313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0ba6e940bc4f74a12b58c048fbcd9d', 'request_id': 'req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.933759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0ba6e940bc4f74a12b58c048fbcd9d', 'request_id': 'req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.950843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] The token cache is being invalidate because project 0c0ba6e940bc4f74a12b58c048fbcd9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:35:31.951205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.952341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:31.954811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1142/2286] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:35:31 2022] DELETE /identity/v3/projects/0c0ba6e940bc4f74a12b58c048fbcd9d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:41.552514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=37,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:41.946325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:57.442751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:57.443283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:57.443283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:57.464442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:57.465668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:57.523575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1145/2287] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:35:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:57.545601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:57.547080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:57.652217 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193aff0-5d4a-4dfc-bb59-163ac84d41c6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:57.661163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c118e8-bb3c-4026-b2ad-36674e15c573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:57.661799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c118e8-bb3c-4026-b2ad-36674e15c573 service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:57.662082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c118e8-bb3c-4026-b2ad-36674e15c573 service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:57.662321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c118e8-bb3c-4026-b2ad-36674e15c573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:57.672103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c118e8-bb3c-4026-b2ad-36674e15c573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:57.673740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c118e8-bb3c-4026-b2ad-36674e15c573 service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:57.682336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1143/2288] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:35:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:58.999936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:59.001959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:59.099397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d8236-97bb-4030-8a15-037f0d4b3152 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:59.104452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:59.105129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:59.105409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:59.105685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] PATH_INFO: `/v3/users/c34116c275fc4c469bdca8c70f81f7b5` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:59.106873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34116c275fc4c469bdca8c70f81f7b5)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:59.110716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:59.240250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34116c275fc4c469bdca8c70f81f7b5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:59.262674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34116c275fc4c469bdca8c70f81f7b5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:59.263576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34116c275fc4c469bdca8c70f81f7b5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:59.272879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34116c275fc4c469bdca8c70f81f7b5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:59.284203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34116c275fc4c469bdca8c70f81f7b5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:35:59.292278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1146/2289] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:35:58 2022] DELETE /identity/v3/users/c34116c275fc4c469bdca8c70f81f7b5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:35:59.296562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:59.297070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:59.297192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:59.338226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:35:59.339810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:59.429442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1144/2290] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:35:59.439791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:59.441273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:59.484214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:59.525003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b9b29-bee5-480d-9597-ca458859edb2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:59.528657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2465d-4f6f-4694-b0c7-301c7e8d9206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:59.529290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2465d-4f6f-4694-b0c7-301c7e8d9206 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:59.529564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2465d-4f6f-4694-b0c7-301c7e8d9206 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:59.529832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2465d-4f6f-4694-b0c7-301c7e8d9206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:59.540047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2465d-4f6f-4694-b0c7-301c7e8d9206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:59.541598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2465d-4f6f-4694-b0c7-301c7e8d9206 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:35:59.553085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1147/2291] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:35:59.893669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:35:59.895848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:35:59.922165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a470067-3d40-4226-b946-d3f0eeee71a2 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:35:59.938644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:35:59.939643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:35:59.940245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:35:59.940765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] PATH_INFO: `/v3/projects/0183e60f976c41d4b1c3e3cd352b5b5a` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:35:59.942665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0183e60f976c41d4b1c3e3cd352b5b5a)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:35:59.944792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.010611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0183e60f976c41d4b1c3e3cd352b5b5a', 'request_id': 'req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:36:00.017621 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0183e60f976c41d4b1c3e3cd352b5b5a', 'request_id': 'req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:36:00.033216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0183e60f976c41d4b1c3e3cd352b5b5a', 'request_id': 'req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:36:00.046030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] The token cache is being invalidate because project 0183e60f976c41d4b1c3e3cd352b5b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:36:00.046283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:36:00.046929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-21c07d61-efdf-4d81-b1ab-7c14cf2875e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:36:00.051691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1145/2292] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:35:59 2022] DELETE /identity/v3/projects/0183e60f976c41d4b1c3e3cd352b5b5a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:36:00.053763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba86e0-03eb-4933-81bd-83f3755ac114 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.054231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba86e0-03eb-4933-81bd-83f3755ac114 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.054324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba86e0-03eb-4933-81bd-83f3755ac114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.077564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f3ba86e0-03eb-4933-81bd-83f3755ac114 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:00.079154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f3ba86e0-03eb-4933-81bd-83f3755ac114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:00.154584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1148/2293] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:00.164242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5d78d-195b-4164-ae38-e17015799b98 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.165046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5d78d-195b-4164-ae38-e17015799b98 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.165046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5d78d-195b-4164-ae38-e17015799b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.190437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-bbb5d78d-195b-4164-ae38-e17015799b98 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:00.191944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-bbb5d78d-195b-4164-ae38-e17015799b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:00.200587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1146/2294] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:00.205333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba86e0-03eb-4933-81bd-83f3755ac114 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:00.216441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba86e0-03eb-4933-81bd-83f3755ac114 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:00.221770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:00.222429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.222707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.222977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.223843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:36:00.224054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:00.225720 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.241606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1149/2295] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:36:00.246114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5d78d-195b-4164-ae38-e17015799b98 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:00.256829 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5d78d-195b-4164-ae38-e17015799b98 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:00.263181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:00.265129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.265129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.265129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.265129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:00.267244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.272998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:00.311965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1147/2296] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:36:00 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:36:00.316557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:00.329584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d2ce0-2d2b-41bc-95d6-e8b5613796cc admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:00.433582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:00.434217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.434502 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.434778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.435459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:00.437497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.466113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1150/2297] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:36:00 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:36:00.470285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:00.483187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84834ca-ae8f-4c75-be42-75998336c462 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:00.488392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:00.489130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.489406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.489680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.490388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:00.492065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.503374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1148/2298] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:36:00.518794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:00.529666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d2ec-0606-4c12-9dd4-f8fbfdb0210c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:00.536408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd1c80-293f-496f-b58a-283447e40359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:00.537057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1c80-293f-496f-b58a-283447e40359 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.537339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1c80-293f-496f-b58a-283447e40359 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.537616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1c80-293f-496f-b58a-283447e40359 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.538327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd1c80-293f-496f-b58a-283447e40359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:00.539980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd1c80-293f-496f-b58a-283447e40359 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.555550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1151/2299] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:36:00.557359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:00.569147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90327b38-3fe8-46a6-92f1-634abf80e7c2 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:00.574566 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:00.575415 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.575816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.576191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] PATH_INFO: `/v3/projects/b509c396597344248cbc5dfcdc33eb31/users/c80c052b0a194c9487ca3314f4f2b8d5/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.594849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b509c396597344248cbc5dfcdc33eb31, user_id=c80c052b0a194c9487ca3314f4f2b8d5, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:00.598132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.620697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1149/2300] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:36:00 2022] PUT /identity/v3/projects/b509c396597344248cbc5dfcdc33eb31/users/c80c052b0a194c9487ca3314f4f2b8d5/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:36:00.622271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d086-175a-4173-b196-1c0cc10be689 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.622551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d086-175a-4173-b196-1c0cc10be689 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.622826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d086-175a-4173-b196-1c0cc10be689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.644751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f2c2d086-175a-4173-b196-1c0cc10be689 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:00.646012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f2c2d086-175a-4173-b196-1c0cc10be689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:00.681500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:00.719172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1152/2301] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:00.729623 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:00.731869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:00.807237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe18e-1088-40fa-b4c0-3ad69146304b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:00.811927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:00.812825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:00.813108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:00.813371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:00.824028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:00.825549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:00.843855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1150/2302] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:06.290939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6889c-cfbf-48d9-bca6-dff6a60160e9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:06.291636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6889c-cfbf-48d9-bca6-dff6a60160e9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:06.291636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6889c-cfbf-48d9-bca6-dff6a60160e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:06.328894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6bf6889c-cfbf-48d9-bca6-dff6a60160e9 None None] MFA Rules not processed for user `c80c052b0a194c9487ca3314f4f2b8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:06.331004 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6bf6889c-cfbf-48d9-bca6-dff6a60160e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:06.428564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1153/2303] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:06.433399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:06.447302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5236-4c47-4652-a6aa-936b6d99705c service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:06.454988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:06.456162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:06.456608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:06.457658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:06.458299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:06.462192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:06.506510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1151/2304] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:36:06 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:36:06.512222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6889c-cfbf-48d9-bca6-dff6a60160e9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:06.526443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6889c-cfbf-48d9-bca6-dff6a60160e9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:06.621288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:06.622014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:06.622298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:06.622873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:06.624184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:06.625591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:06.661183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1154/2305] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:36:06 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:36:06.662493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:06.681070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196645-e8f5-4c3b-92f2-70cc01551f75 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:06.687995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:06.688708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:06.689018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:06.689498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:06.690345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:06.693889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:06.714808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:06.715530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1152/2306] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:36:06.730418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe625e-cca8-4f29-81b5-aa916acbc08c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:06.736707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:06.737445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:06.737728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:06.738009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] PATH_INFO: `/v3/projects/56cc17add9ef413e94f10db78a676b68/users/0aac93785bae41b3a819c523f303944d/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:06.761505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cc17add9ef413e94f10db78a676b68, user_id=0aac93785bae41b3a819c523f303944d, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:06.764392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:06.797170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:06.797946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1155/2307] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:36:06 2022] PUT /identity/v3/projects/56cc17add9ef413e94f10db78a676b68/users/0aac93785bae41b3a819c523f303944d/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:36:06.810898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72bb3b-5b4b-42fc-a723-d359058064ce admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:06.968896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10d4ba-f24e-4982-83e0-aff1ec091682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:06.970452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d4ba-f24e-4982-83e0-aff1ec091682 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:06.971114 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d4ba-f24e-4982-83e0-aff1ec091682 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:06.971557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d4ba-f24e-4982-83e0-aff1ec091682 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:06.972515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10d4ba-f24e-4982-83e0-aff1ec091682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:06.975211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10d4ba-f24e-4982-83e0-aff1ec091682 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:07.012090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1153/2308] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:36:07.017859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:07.047653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10845e-88c8-461e-b55c-adfb8ffa08ca admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:07.055972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:07.056659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:07.056949 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:07.057233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] PATH_INFO: `/v3/projects/56cc17add9ef413e94f10db78a676b68/users/0aac93785bae41b3a819c523f303944d/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:07.059969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cc17add9ef413e94f10db78a676b68, user_id=0aac93785bae41b3a819c523f303944d, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:07.062715 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:07.081156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1156/2309] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:36:07 2022] PUT /identity/v3/projects/56cc17add9ef413e94f10db78a676b68/users/0aac93785bae41b3a819c523f303944d/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:36:13.208211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:13.210383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:13.210718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:13.256478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] MFA Rules not processed for user `0aac93785bae41b3a819c523f303944d`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:13.258515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:13.266511 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:13.349899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1154/2310] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:13.358317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:13.360364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:13.394107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:13.469341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d46d82-e019-478f-a97c-8db731a6bbe9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:13.475302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3fc0-978a-4ff9-9ffe-652c39bf08a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:13.476184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3fc0-978a-4ff9-9ffe-652c39bf08a0 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:13.476463 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3fc0-978a-4ff9-9ffe-652c39bf08a0 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:13.477000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3fc0-978a-4ff9-9ffe-652c39bf08a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:13.565636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3fc0-978a-4ff9-9ffe-652c39bf08a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:13.567874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3fc0-978a-4ff9-9ffe-652c39bf08a0 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:13.581679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1157/2311] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:14.340398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:14.341832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:14.414132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397851c9-9d60-4874-9144-ca19608187c3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:14.419086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ac94b-24e3-4626-806a-56ae6cd4458a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:14.419767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ac94b-24e3-4626-806a-56ae6cd4458a service placement] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:14.420007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ac94b-24e3-4626-806a-56ae6cd4458a service placement] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:14.420315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ac94b-24e3-4626-806a-56ae6cd4458a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:14.422129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-940ac94b-24e3-4626-806a-56ae6cd4458a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:14.435336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ac94b-24e3-4626-806a-56ae6cd4458a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:14.436990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ac94b-24e3-4626-806a-56ae6cd4458a service placement] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:14.454172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1155/2312] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:14.809655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b58c8-5839-4315-8e4d-b260fc128b2d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:14.810206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b58c8-5839-4315-8e4d-b260fc128b2d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:14.810441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b58c8-5839-4315-8e4d-b260fc128b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:14.836760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-061b58c8-5839-4315-8e4d-b260fc128b2d None None] MFA Rules not processed for user `c80c052b0a194c9487ca3314f4f2b8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:14.838177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-061b58c8-5839-4315-8e4d-b260fc128b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:14.852600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1158/2313] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:16.282765 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76f44-84d1-4d3e-b747-5222010674b1 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.283392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76f44-84d1-4d3e-b747-5222010674b1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.283490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76f44-84d1-4d3e-b747-5222010674b1 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:16.285337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1156/2314] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:36:16.312434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701982f-208d-4317-b3d7-f5962ff252a7 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.315135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701982f-208d-4317-b3d7-f5962ff252a7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.315435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701982f-208d-4317-b3d7-f5962ff252a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:16.340677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7701982f-208d-4317-b3d7-f5962ff252a7 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:16.342645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7701982f-208d-4317-b3d7-f5962ff252a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:16.403162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1159/2315] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:36:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:16.404643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c76f44-84d1-4d3e-b747-5222010674b1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:16.406569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f9c76f44-84d1-4d3e-b747-5222010674b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:16.513213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c76f44-84d1-4d3e-b747-5222010674b1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:16.517713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a41db-dc7b-4474-b02f-0a831b03236e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1e0e81d0ee04020b43c28347ef3ab6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:16.518424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a41db-dc7b-4474-b02f-0a831b03236e service glance] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.519245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a41db-dc7b-4474-b02f-0a831b03236e service glance] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.519516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a41db-dc7b-4474-b02f-0a831b03236e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:16.540778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a41db-dc7b-4474-b02f-0a831b03236e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:16.543195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a41db-dc7b-4474-b02f-0a831b03236e service glance] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:16.562866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1157/2316] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:16.649252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703f69c-7f82-429f-a126-c0e59a960748 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.649252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703f69c-7f82-429f-a126-c0e59a960748 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.649429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703f69c-7f82-429f-a126-c0e59a960748 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:16.650774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1160/2317] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:36:16.656669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f76f7b-56a6-45e2-8ca7-db248ea09aa4 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.657053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f76f7b-56a6-45e2-8ca7-db248ea09aa4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.657407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f76f7b-56a6-45e2-8ca7-db248ea09aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:16.684427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-20f76f7b-56a6-45e2-8ca7-db248ea09aa4 None None] MFA Rules not processed for user `c206251915e74dba98b9422cf2f026d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:16.686006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-20f76f7b-56a6-45e2-8ca7-db248ea09aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:16.767844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:16.803338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1158/2318] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:36:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:16.816819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703f69c-7f82-429f-a126-c0e59a960748 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:16.818558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e703f69c-7f82-429f-a126-c0e59a960748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:16.842889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703f69c-7f82-429f-a126-c0e59a960748 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:16.847761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ae01-8640-4878-a1eb-304067961feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:16.848611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ae01-8640-4878-a1eb-304067961feb service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.848893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ae01-8640-4878-a1eb-304067961feb service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.849164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ae01-8640-4878-a1eb-304067961feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:16.860794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ae01-8640-4878-a1eb-304067961feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:16.862582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ae01-8640-4878-a1eb-304067961feb service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:16.873889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1161/2319] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:16.965034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efeeed-1707-4028-bc81-8682f5739d74 None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.965385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efeeed-1707-4028-bc81-8682f5739d74 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.965771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efeeed-1707-4028-bc81-8682f5739d74 None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:16.967387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1159/2320] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:36:16.974443 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92de2a-4629-42f6-bbfa-ecae24eb258a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:16.974712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92de2a-4629-42f6-bbfa-ecae24eb258a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:16.974988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92de2a-4629-42f6-bbfa-ecae24eb258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:17.010536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0b92de2a-4629-42f6-bbfa-ecae24eb258a None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:17.021311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0b92de2a-4629-42f6-bbfa-ecae24eb258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:17.040933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1162/2321] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:36:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:17.053975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efeeed-1707-4028-bc81-8682f5739d74 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:17.086096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efeeed-1707-4028-bc81-8682f5739d74 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:17.090247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:17.090937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:17.091332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:17.091915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:17.139207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:17.140743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:17.159222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1160/2322] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:20.346815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3e1ee-d139-4efc-8317-d4f84c0c86e0 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:20.347322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3e1ee-d139-4efc-8317-d4f84c0c86e0 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:20.347703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3e1ee-d139-4efc-8317-d4f84c0c86e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:20.370825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-bec3e1ee-d139-4efc-8317-d4f84c0c86e0 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:20.372389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bec3e1ee-d139-4efc-8317-d4f84c0c86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:20.443890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1163/2323] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:36:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:36:20.457264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:20.459176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:20.565488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4502d-8fdc-4b2b-ad67-4154df04448e service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:20.571352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:20.572131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:20.572780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:20.573178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:20.583775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:20.585606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:20.599434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1161/2324] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:36:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:36:30.431984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:30.591658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=46 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:37.736898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190a70c-c423-43af-964e-5b23c3a64bd5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:37.737421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190a70c-c423-43af-964e-5b23c3a64bd5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:37.737618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190a70c-c423-43af-964e-5b23c3a64bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:37.767520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0190a70c-c423-43af-964e-5b23c3a64bd5 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:37.769221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0190a70c-c423-43af-964e-5b23c3a64bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:37.778157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1164/2325] 10.222.0.58 () {58 vars in 967 bytes} [Thu Jul 28 06:36:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:36:37.799961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:37.812183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aef91-c093-46da-a2fe-2df2c82f6882 service swift] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:37.818731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:37.819417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:37.819724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:37.820280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:37.831853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:37.834830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:37.859748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1162/2326] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:36:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:36:41.103010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465e8aa-95ee-4e7e-b2e8-d6c317655d5c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:41.103531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465e8aa-95ee-4e7e-b2e8-d6c317655d5c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:41.103531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465e8aa-95ee-4e7e-b2e8-d6c317655d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:41.122399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2465e8aa-95ee-4e7e-b2e8-d6c317655d5c None None] MFA Rules not processed for user `f25041ca39b84b0b9a3b742d0e43e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:41.123756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2465e8aa-95ee-4e7e-b2e8-d6c317655d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:41.180959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1165/2327] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:47.852486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=6 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:48.750038 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:48.760614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a919f05-9324-4e2f-a667-6bf08bc661a3 service swift] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:48.771149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d7cd7-506b-425e-93f8-0f048a3021e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:48.771910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d7cd7-506b-425e-93f8-0f048a3021e0 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:48.772186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d7cd7-506b-425e-93f8-0f048a3021e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:48.772427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d7cd7-506b-425e-93f8-0f048a3021e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:48.782239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d7cd7-506b-425e-93f8-0f048a3021e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:48.783741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d7cd7-506b-425e-93f8-0f048a3021e0 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:48.793895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1163/2328] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:51.173577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=28 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:52.183688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230088fc-84c4-454f-a26a-2780e4ddfdc5 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:52.184297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230088fc-84c4-454f-a26a-2780e4ddfdc5 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:52.184297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230088fc-84c4-454f-a26a-2780e4ddfdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:52.204530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-230088fc-84c4-454f-a26a-2780e4ddfdc5 None None] MFA Rules not processed for user `ec303a823f554fae8e5faf6f1e3df154`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:36:52.205766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-230088fc-84c4-454f-a26a-2780e4ddfdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:52.264370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1166/2329] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:36:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:36:58.789106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=6 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:02.256372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=25 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:29.147118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178d69-2489-40cd-8660-615d422ef4a6 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:37:29.147679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178d69-2489-40cd-8660-615d422ef4a6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:37:29.147784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178d69-2489-40cd-8660-615d422ef4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:37:29.173326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-fb178d69-2489-40cd-8660-615d422ef4a6 None None] MFA Rules not processed for user `270693550b1e4d4888290abe6030b108`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:37:29.174602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-fb178d69-2489-40cd-8660-615d422ef4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:37:29.239210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1164/2330] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:37:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:37:31.153705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630cc3c-f724-4ab4-8b45-65c06f945430 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:37:31.154343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630cc3c-f724-4ab4-8b45-65c06f945430 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:37:31.154343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630cc3c-f724-4ab4-8b45-65c06f945430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:37:31.174578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4630cc3c-f724-4ab4-8b45-65c06f945430 None None] MFA Rules not processed for user `7658a799ca8d4cc7ad03903cd23794b4`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:37:31.175840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4630cc3c-f724-4ab4-8b45-65c06f945430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:37:31.239562 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1167/2331] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:37:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:37:39.231849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=25 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:41.232384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=25 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:57.182718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178d69-2489-40cd-8660-615d422ef4a6 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:37:57.199758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178d69-2489-40cd-8660-615d422ef4a6 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:37:57.214352 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:37:57.215129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:37:57.215413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:37:57.215722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:37:57.217923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:37:57.234322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:37:57.236131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:37:57.249145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1165/2332] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:37:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:37:58.807154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c106fe-b26f-48be-a125-5b63cc9a6309 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:37:58.807884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c106fe-b26f-48be-a125-5b63cc9a6309 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:37:58.807884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c106fe-b26f-48be-a125-5b63cc9a6309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:37:58.829862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-31c106fe-b26f-48be-a125-5b63cc9a6309 None None] MFA Rules not processed for user `f25041ca39b84b0b9a3b742d0e43e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:37:58.831193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-31c106fe-b26f-48be-a125-5b63cc9a6309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:37:58.839827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1168/2333] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:37:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:37:59.117360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:37:59.126764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03b7e-402e-4043-9464-dc88230f661f service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:37:59.130770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:37:59.131373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:37:59.131674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:37:59.131942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:37:59.133819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:37:59.148373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:37:59.149824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:37:59.161532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1166/2334] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:37:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:04.623604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c106fe-b26f-48be-a125-5b63cc9a6309 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:04.640951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c106fe-b26f-48be-a125-5b63cc9a6309 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:04.656331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:04.657477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:04.657995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:04.658448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:04.661578 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:04.763723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:04.766496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:04.780829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1169/2335] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:09.156236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=12 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:09.181459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:09.183215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:09.198549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ebaa-50dc-4558-9065-17c47d38a0ea service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:09.210206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:09.210206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:09.210206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:09.210206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:09.210933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:09.222652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:09.224907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:09.237923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1167/2336] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:09.287803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:09.289735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:09.303251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ccf85-c601-4c17-ade8-a4a3a379c88d service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:09.310645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:09.311322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:09.311606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:09.311914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] PATH_INFO: `/v3/users/ec303a823f554fae8e5faf6f1e3df154` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:09.313580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec303a823f554fae8e5faf6f1e3df154)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:09.315043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:09.385267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec303a823f554fae8e5faf6f1e3df154'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.399275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec303a823f554fae8e5faf6f1e3df154'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.400036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec303a823f554fae8e5faf6f1e3df154'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.408916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec303a823f554fae8e5faf6f1e3df154'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.419083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a4d6723-0bc3-4bc3-99da-57c60e5ef35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec303a823f554fae8e5faf6f1e3df154'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.429568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1170/2337] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:09 2022] DELETE /identity/v3/users/ec303a823f554fae8e5faf6f1e3df154 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:09.655727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:09.672555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96db03-7641-491f-879a-75225dd6b009 service placement] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:09.736194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:09.736856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:09.737138 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:09.737412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] PATH_INFO: `/v3/projects/9fbcf1645e82413abc80bc89892f8891` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:09.738576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fbcf1645e82413abc80bc89892f8891)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:09.745323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:09.801288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fbcf1645e82413abc80bc89892f8891', 'request_id': 'req-50e30df0-9103-4364-ae7e-a65fb2d578fa'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.809031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fbcf1645e82413abc80bc89892f8891', 'request_id': 'req-50e30df0-9103-4364-ae7e-a65fb2d578fa'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.818809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fbcf1645e82413abc80bc89892f8891', 'request_id': 'req-50e30df0-9103-4364-ae7e-a65fb2d578fa'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.829922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] The token cache is being invalidate because project 9fbcf1645e82413abc80bc89892f8891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:09.830212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.830864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-50e30df0-9103-4364-ae7e-a65fb2d578fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:09.832477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1168/2338] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:09 2022] DELETE /identity/v3/projects/9fbcf1645e82413abc80bc89892f8891 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:09.837687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676b0b-e76f-4495-9124-8536378e2eb8 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:09.838098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676b0b-e76f-4495-9124-8536378e2eb8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:09.838466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676b0b-e76f-4495-9124-8536378e2eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:09.861021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-1a676b0b-e76f-4495-9124-8536378e2eb8 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:09.862129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1a676b0b-e76f-4495-9124-8536378e2eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:09.926178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:09.938196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1171/2339] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:09.948523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05876-fc76-4494-8cc6-5d5d96737777 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:09.948820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05876-fc76-4494-8cc6-5d5d96737777 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:09.949103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05876-fc76-4494-8cc6-5d5d96737777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:09.974394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-36f05876-fc76-4494-8cc6-5d5d96737777 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:09.975536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-36f05876-fc76-4494-8cc6-5d5d96737777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:09.986832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1169/2340] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:09.991378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676b0b-e76f-4495-9124-8536378e2eb8 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.005705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676b0b-e76f-4495-9124-8536378e2eb8 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.013788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.014842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.015333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.015875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.017185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:38:10.017691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.020205 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.038899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1172/2341] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:38:10.045792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f05876-fc76-4494-8cc6-5d5d96737777 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.063276 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f05876-fc76-4494-8cc6-5d5d96737777 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.068237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.068917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.069137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.069407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.070070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.072051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.106512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1170/2342] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:10 2022] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:10.111264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.122418 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835aef3-6f6c-46d5-9380-aae2fc62b7db admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.186090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.186740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.187020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.187296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.188027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.190094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.219020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1173/2343] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:10 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:10.224547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.235535 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7f64-3e48-426e-8f4b-29370cdd365d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.240516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.241151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.241428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.241669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.242404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.244081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.255274 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1171/2344] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:10.259559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.270549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f60ec-0f66-43fe-91b2-b111b3016b42 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.276056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212cc00-6285-4bbd-9727-8e3f3044091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.276794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cc00-6285-4bbd-9727-8e3f3044091d admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.277080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cc00-6285-4bbd-9727-8e3f3044091d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.277475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cc00-6285-4bbd-9727-8e3f3044091d admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.278709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212cc00-6285-4bbd-9727-8e3f3044091d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.281223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212cc00-6285-4bbd-9727-8e3f3044091d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.296900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1174/2345] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:10.298526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.313226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6b49-dd4c-47f2-855f-1428c5fa730e admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.324174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.325216 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.325744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.326310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] PATH_INFO: `/v3/projects/ebdf7332bc5d422ebfef2228a7bb2e52/users/7dcc5c3461094aeebec8c61bae5bcab1/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.357523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdf7332bc5d422ebfef2228a7bb2e52, user_id=7dcc5c3461094aeebec8c61bae5bcab1, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.362786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.397635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1172/2346] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:10 2022] PUT /identity/v3/projects/ebdf7332bc5d422ebfef2228a7bb2e52/users/7dcc5c3461094aeebec8c61bae5bcab1/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:10.404590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e6a6-3be6-4727-97eb-00e7bb31684a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.404861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e6a6-3be6-4727-97eb-00e7bb31684a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.405134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e6a6-3be6-4727-97eb-00e7bb31684a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.444875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-28b9e6a6-3be6-4727-97eb-00e7bb31684a None None] MFA Rules not processed for user `7dcc5c3461094aeebec8c61bae5bcab1`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:10.446350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-28b9e6a6-3be6-4727-97eb-00e7bb31684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:10.530208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1175/2347] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:10.541603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.562137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:10.625902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9806-ce6d-485d-a5b1-b6646407ea49 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.631935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.632673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.633053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.633427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.634282 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.636353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.681355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1173/2348] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:10 2022] POST /identity/v3/projects => generated 405 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:10.685710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e6a6-3be6-4727-97eb-00e7bb31684a None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.696979 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e6a6-3be6-4727-97eb-00e7bb31684a None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.750654 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:10.760166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.760970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.761304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.761623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.762452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.764857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.793585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1176/2349] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:10 2022] POST /identity/v3/users => generated 309 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:38:10.798111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.809925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9779-873c-47b2-966f-c5de20e2f91b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.814799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.815418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.815732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.816013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.816723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.818387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.829524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1174/2350] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:38:10.834022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.844511 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d2e1-2bea-49a4-a6a0-8287a9c28102 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.849216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.849886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.850170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.850444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] PATH_INFO: `/v3/projects/fa5cfacb813748169499cbfce98f6762/users/5cf6bf765ddc479f82d2f63f38536841/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.866600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5cfacb813748169499cbfce98f6762, user_id=5cf6bf765ddc479f82d2f63f38536841, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.868889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.885053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1177/2351] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:10 2022] PUT /identity/v3/projects/fa5cfacb813748169499cbfce98f6762/users/5cf6bf765ddc479f82d2f63f38536841/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:10.890691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:10.906876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157468b6-5a29-48bf-851e-9e799ee33f2b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:10.980858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a12de-125b-4c09-8aea-7aaffa4dcef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:10.981493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a12de-125b-4c09-8aea-7aaffa4dcef3 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:10.981778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a12de-125b-4c09-8aea-7aaffa4dcef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:10.982056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a12de-125b-4c09-8aea-7aaffa4dcef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:10.982750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a12de-125b-4c09-8aea-7aaffa4dcef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:10.984406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a12de-125b-4c09-8aea-7aaffa4dcef3 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:10.995445 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1175/2352] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:38:11.001207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:11.012106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24173f-9660-4f2a-a582-e55d54c2789f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:11.016939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:11.017677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:11.017957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:11.018231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] PATH_INFO: `/v3/projects/fa5cfacb813748169499cbfce98f6762/users/5cf6bf765ddc479f82d2f63f38536841/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:11.020302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5cfacb813748169499cbfce98f6762, user_id=5cf6bf765ddc479f82d2f63f38536841, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:11.022961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:11.037336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1178/2353] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:11 2022] PUT /identity/v3/projects/fa5cfacb813748169499cbfce98f6762/users/5cf6bf765ddc479f82d2f63f38536841/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:11.050214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3892-2430-405f-9293-a1551d6873a6 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:11.050682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3892-2430-405f-9293-a1551d6873a6 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:11.051261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3892-2430-405f-9293-a1551d6873a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:11.102423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-c9ac3892-2430-405f-9293-a1551d6873a6 None None] MFA Rules not processed for user `5cf6bf765ddc479f82d2f63f38536841`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:11.103701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c9ac3892-2430-405f-9293-a1551d6873a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:11.182912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1176/2354] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:11.195164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:11.198036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:11.278516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8a6f4-141d-4979-b4a4-c9acbf14bc8f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:11.283262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69905898-26e7-4e76-8c07-91058bd0f2a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:11.284220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69905898-26e7-4e76-8c07-91058bd0f2a7 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:11.284500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69905898-26e7-4e76-8c07-91058bd0f2a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:11.284773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69905898-26e7-4e76-8c07-91058bd0f2a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:11.296971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69905898-26e7-4e76-8c07-91058bd0f2a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:11.299399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69905898-26e7-4e76-8c07-91058bd0f2a7 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:11.312553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1179/2355] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:11.481399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac3892-2430-405f-9293-a1551d6873a6 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:11.494803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:11.554915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac3892-2430-405f-9293-a1551d6873a6 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:11.560206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:11.560978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:11.561308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:11.561620 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] PATH_INFO: `/v3/users/7dcc5c3461094aeebec8c61bae5bcab1` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:11.562937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcc5c3461094aeebec8c61bae5bcab1)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:11.565158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:11.626292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcc5c3461094aeebec8c61bae5bcab1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:11.647496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcc5c3461094aeebec8c61bae5bcab1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:11.658368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcc5c3461094aeebec8c61bae5bcab1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:11.659260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcc5c3461094aeebec8c61bae5bcab1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:11.670140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcc5c3461094aeebec8c61bae5bcab1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:11.685008 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1177/2356] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:11 2022] DELETE /identity/v3/users/7dcc5c3461094aeebec8c61bae5bcab1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:11.691424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:11.691958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:11.692070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:11.716998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:11.718837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:11.837892 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1180/2357] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:11.850476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:11.852777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:11.945095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359fc7-0e2c-4e2a-aa07-20806672b26a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:11.949447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:11.950225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:11.950563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:11.950901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:11.962571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:11.964312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:11.976545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1178/2358] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:12.359685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:12.363933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:12.390531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb514f0-f8c4-4765-a61c-c69b89b07798 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:12.398819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:12.399823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:12.400238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:12.400661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] PATH_INFO: `/v3/projects/ebdf7332bc5d422ebfef2228a7bb2e52` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:12.402411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdf7332bc5d422ebfef2228a7bb2e52)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:12.405494 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:12.485962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:12.491804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdf7332bc5d422ebfef2228a7bb2e52', 'request_id': 'req-2768a203-1690-4ccd-9452-69d5ef73e907'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.501514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdf7332bc5d422ebfef2228a7bb2e52', 'request_id': 'req-2768a203-1690-4ccd-9452-69d5ef73e907'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.511550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdf7332bc5d422ebfef2228a7bb2e52', 'request_id': 'req-2768a203-1690-4ccd-9452-69d5ef73e907'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.523299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] The token cache is being invalidate because project ebdf7332bc5d422ebfef2228a7bb2e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:12.523604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.524417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.526536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1181/2359] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:12 2022] DELETE /identity/v3/projects/ebdf7332bc5d422ebfef2228a7bb2e52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:12.530519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:12.542552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2cdd6-99fd-4779-a37a-3fc1b86d4232 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:12.577803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:12.618492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:12.619563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:12.620082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:12.620572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] PATH_INFO: `/v3/users/5cf6bf765ddc479f82d2f63f38536841` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:12.622329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf6bf765ddc479f82d2f63f38536841)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:12.624558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:12.681726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf6bf765ddc479f82d2f63f38536841'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.695179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf6bf765ddc479f82d2f63f38536841'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.703013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf6bf765ddc479f82d2f63f38536841'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.703880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf6bf765ddc479f82d2f63f38536841'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.715915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-2602295b-2e6a-4c95-8b86-1557f2218a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf6bf765ddc479f82d2f63f38536841'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:12.727134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1179/2360] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:12 2022] DELETE /identity/v3/users/5cf6bf765ddc479f82d2f63f38536841 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:13.092973 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:13.096433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:13.123603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768a203-1690-4ccd-9452-69d5ef73e907 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:13.215592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:13.218762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.219246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.219765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] PATH_INFO: `/v3/projects/fa5cfacb813748169499cbfce98f6762` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.221970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5cfacb813748169499cbfce98f6762)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:13.225663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:13.292784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5cfacb813748169499cbfce98f6762', 'request_id': 'req-922041d9-91e3-4f6d-836e-2be420760d89'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:13.300052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5cfacb813748169499cbfce98f6762', 'request_id': 'req-922041d9-91e3-4f6d-836e-2be420760d89'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:13.310237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5cfacb813748169499cbfce98f6762', 'request_id': 'req-922041d9-91e3-4f6d-836e-2be420760d89'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:13.328165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] The token cache is being invalidate because project fa5cfacb813748169499cbfce98f6762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:13.328461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:13.329166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-922041d9-91e3-4f6d-836e-2be420760d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:13.330930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1182/2361] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:13 2022] DELETE /identity/v3/projects/fa5cfacb813748169499cbfce98f6762 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:13.336229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e7f1-9e02-44ba-882f-5bfa377490c0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.336538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e7f1-9e02-44ba-882f-5bfa377490c0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.336800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e7f1-9e02-44ba-882f-5bfa377490c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.359805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7c38e7f1-9e02-44ba-882f-5bfa377490c0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:13.361323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7c38e7f1-9e02-44ba-882f-5bfa377490c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:13.451814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1180/2362] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:13.460286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97c85-d54f-4d55-b6da-9d5ac27d09da None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.461118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97c85-d54f-4d55-b6da-9d5ac27d09da None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.461279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97c85-d54f-4d55-b6da-9d5ac27d09da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.484197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3ca97c85-d54f-4d55-b6da-9d5ac27d09da None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:13.485626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3ca97c85-d54f-4d55-b6da-9d5ac27d09da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:13.495341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1183/2363] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:13.502124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e7f1-9e02-44ba-882f-5bfa377490c0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:13.518515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e7f1-9e02-44ba-882f-5bfa377490c0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:13.526219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:13.527288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.527806 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.528268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.529483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:38:13.529988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:13.532766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:13.552876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1181/2364] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:38:13.557671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca97c85-d54f-4d55-b6da-9d5ac27d09da None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:13.567790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca97c85-d54f-4d55-b6da-9d5ac27d09da None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:13.573793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:13.574444 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.574717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.574987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.575688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:13.577634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:13.612944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1184/2365] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:13 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:13.617597 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:13.628237 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf406809-0491-43b9-bb2f-97eda495ec6f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:13.667358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:13.697991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:13.698643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.698935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.699207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.700018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:13.701979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:13.732699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1182/2366] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:13 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:13.743007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:13.754344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e8f6-7178-47e9-a277-227459524ef1 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:13.759385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:13.760127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.760441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.760748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.761609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:13.763285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:13.774948 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1185/2367] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:13.780890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:13.792802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9e88d-8f37-406d-8376-ed1a010a040b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:13.800132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c0c84-09a2-4dd1-a1ff-f4fd0e516dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:13.801081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c0c84-09a2-4dd1-a1ff-f4fd0e516dcc admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.801370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c0c84-09a2-4dd1-a1ff-f4fd0e516dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.801677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c0c84-09a2-4dd1-a1ff-f4fd0e516dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.802684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c0c84-09a2-4dd1-a1ff-f4fd0e516dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:13.805897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c0c84-09a2-4dd1-a1ff-f4fd0e516dcc admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:13.819701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1183/2368] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:13.824575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:13.838386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930b6c-3193-4095-a953-20cf5bd9cce2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:13.843880 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:13.844580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.844854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.845128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] PATH_INFO: `/v3/projects/2511a9afb38e4c2eafd4e987a3eebd50/users/cb540320f5194cf2bc46ae915cda5385/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.863735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2511a9afb38e4c2eafd4e987a3eebd50, user_id=cb540320f5194cf2bc46ae915cda5385, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:13.868963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:13.884638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:13.894540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1186/2369] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:13 2022] PUT /identity/v3/projects/2511a9afb38e4c2eafd4e987a3eebd50/users/cb540320f5194cf2bc46ae915cda5385/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:13.913064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c7046-6097-4ea3-8929-fcb1e77899de None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:13.913553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c7046-6097-4ea3-8929-fcb1e77899de None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:13.914030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c7046-6097-4ea3-8929-fcb1e77899de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:13.962896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b90c7046-6097-4ea3-8929-fcb1e77899de None None] MFA Rules not processed for user `cb540320f5194cf2bc46ae915cda5385`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:13.964992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b90c7046-6097-4ea3-8929-fcb1e77899de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:14.069447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1184/2370] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:14.075927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.186701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed4a00-ed7e-454b-9c7c-271109945f8a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.197515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.198020 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.198506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.199045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.200334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:14.204448 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:14.241488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1187/2371] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:14 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:38:14.246438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c7046-6097-4ea3-8929-fcb1e77899de None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.264073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c7046-6097-4ea3-8929-fcb1e77899de None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.361767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.362662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.363150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.363672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.364660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:14.368044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:14.403908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1185/2372] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:14 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:14.404102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.418521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea8a60-929d-4952-b71a-1da5aa3addb3 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.424012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.424683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.425001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.425406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.426185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:14.427868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:14.440171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1188/2373] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:38:14.444776 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.455421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815541-c0b4-42d6-9d44-3ef87d7da342 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.461060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.461790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.462172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.462493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] PATH_INFO: `/v3/projects/9b9b96d9bf914d44bd52f50992929342/users/e9dd200ebab74714a1142d1529b497af/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.478855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9b96d9bf914d44bd52f50992929342, user_id=e9dd200ebab74714a1142d1529b497af, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:14.481561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:14.495204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1186/2374] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:14 2022] PUT /identity/v3/projects/9b9b96d9bf914d44bd52f50992929342/users/e9dd200ebab74714a1142d1529b497af/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:14.499604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.511381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdfdd7-3acd-47f0-865b-76d8fa3d6582 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.572038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33b01a-1649-4feb-82f5-9df65e545c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.572630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b01a-1649-4feb-82f5-9df65e545c01 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.572958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b01a-1649-4feb-82f5-9df65e545c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.573228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b01a-1649-4feb-82f5-9df65e545c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.573851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33b01a-1649-4feb-82f5-9df65e545c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:14.575452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33b01a-1649-4feb-82f5-9df65e545c01 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:14.586176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1189/2375] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:14.590370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.601379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e32c-7a5e-425a-86a5-c179ea0dfe48 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.606288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.606957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.607363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.607677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] PATH_INFO: `/v3/projects/9b9b96d9bf914d44bd52f50992929342/users/e9dd200ebab74714a1142d1529b497af/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.609784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9b96d9bf914d44bd52f50992929342, user_id=e9dd200ebab74714a1142d1529b497af, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:14.612523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:14.618447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:14.626234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1187/2376] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:14 2022] PUT /identity/v3/projects/9b9b96d9bf914d44bd52f50992929342/users/e9dd200ebab74714a1142d1529b497af/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:14.638075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2123-c8de-43c2-8701-bbfcdfc8aa20 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.638360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2123-c8de-43c2-8701-bbfcdfc8aa20 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.638638 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2123-c8de-43c2-8701-bbfcdfc8aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.668856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-787c2123-c8de-43c2-8701-bbfcdfc8aa20 None None] MFA Rules not processed for user `e9dd200ebab74714a1142d1529b497af`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:14.670215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-787c2123-c8de-43c2-8701-bbfcdfc8aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:14.735834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:14.746897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1190/2377] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:14.759732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.762482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:14.829705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a180192-14a0-4193-971e-e04c1f208f8f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.834966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.836033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.836534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.836989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:14.852941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:14.855268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:14.870319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1188/2378] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:14.950533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2123-c8de-43c2-8701-bbfcdfc8aa20 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:14.961365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2123-c8de-43c2-8701-bbfcdfc8aa20 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:14.965864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:14.966497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:14.966777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:14.967050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:15.038358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:15.039874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:15.049430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1191/2379] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:20.782735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:20.784586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:20.864735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff46fa-62c9-49bb-8eae-78683a827200 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:20.873605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:20.874688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:20.875180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:20.875688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:20.878838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:20.977768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:20.980682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:20.995321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1189/2380] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:38:25.045230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=30 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:30.989342 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=83 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:36.758744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:36.773755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb537-9128-4ac5-bd20-60d76f30b8fd service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:36.779928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:36.780866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:36.781239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:36.781643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:36.784381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:36.815484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:36.817332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:36.848304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1192/2381] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:38:42.857659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:42.860005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:42.932635 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b73322-8900-4aae-b4cc-4e24116b861a service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:42.938668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a5a64-755a-4ae5-8de6-765ddf75c724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:42.939893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5a64-755a-4ae5-8de6-765ddf75c724 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:42.940469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5a64-755a-4ae5-8de6-765ddf75c724 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:42.940973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5a64-755a-4ae5-8de6-765ddf75c724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:42.943651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4e0a5a64-755a-4ae5-8de6-765ddf75c724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:43.021867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a5a64-755a-4ae5-8de6-765ddf75c724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:43.023874 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a5a64-755a-4ae5-8de6-765ddf75c724 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:43.041126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1190/2382] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:46.830783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=6 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:47.298241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:47.300673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:47.344167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60137-d90e-47a3-8485-0eb056fe547a service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:47.353025 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:47.356245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:47.357181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:47.357805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] PATH_INFO: `/v3/users/270693550b1e4d4888290abe6030b108` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:47.361944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270693550b1e4d4888290abe6030b108)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:47.365396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:47.482910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270693550b1e4d4888290abe6030b108'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:47.517743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270693550b1e4d4888290abe6030b108'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:47.519044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270693550b1e4d4888290abe6030b108'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:47.545834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270693550b1e4d4888290abe6030b108'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:47.560866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270693550b1e4d4888290abe6030b108'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:47.568259 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1193/2383] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:47 2022] DELETE /identity/v3/users/270693550b1e4d4888290abe6030b108 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:47.706680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:47.707366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:47.707366 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:47.732361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:47.734085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:47.819108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:47.824426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:47.852093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1191/2384] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:38:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:47.854508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:47.860589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:47.976048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53334b-5659-4561-ba25-5eed71178af8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:47.982201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:47.982692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:47.982982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:47.983262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] PATH_INFO: `/v3/users/cb540320f5194cf2bc46ae915cda5385` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:47.984763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb540320f5194cf2bc46ae915cda5385)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:47.985986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:47.987367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:47.997013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf0849-9a8a-4c04-ba62-2476a023eed0 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:48.003579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:48.004343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.004669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.005109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] PATH_INFO: `/v3/projects/ac6039b5403a4f44966868ddf7715f8e` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.006223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6039b5403a4f44966868ddf7715f8e)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:48.008242 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:48.072884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb540320f5194cf2bc46ae915cda5385'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.092868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb540320f5194cf2bc46ae915cda5385'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.093856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb540320f5194cf2bc46ae915cda5385'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.106096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb540320f5194cf2bc46ae915cda5385'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.109854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:48.121701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb540320f5194cf2bc46ae915cda5385'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.123340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6039b5403a4f44966868ddf7715f8e', 'request_id': 'req-85a556bb-903d-4d11-8732-575e5d8706ed'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.137155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1194/2385] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:47 2022] DELETE /identity/v3/users/cb540320f5194cf2bc46ae915cda5385 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:48.138978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:48.139732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6039b5403a4f44966868ddf7715f8e', 'request_id': 'req-85a556bb-903d-4d11-8732-575e5d8706ed'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.141991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.158117 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6039b5403a4f44966868ddf7715f8e', 'request_id': 'req-85a556bb-903d-4d11-8732-575e5d8706ed'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.180958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] The token cache is being invalidate because project ac6039b5403a4f44966868ddf7715f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:48.180958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.180958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-85a556bb-903d-4d11-8732-575e5d8706ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:48.182907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1192/2386] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:47 2022] DELETE /identity/v3/projects/ac6039b5403a4f44966868ddf7715f8e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:48.184688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.185098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.185606 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.213737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:48.215557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.261424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b6058-ee86-4548-bbb5-f73bdee71dbd admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:48.267471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2187d-a5dc-4507-a0f3-f050749d19c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:48.268183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2187d-a5dc-4507-a0f3-f050749d19c7 service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.268471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2187d-a5dc-4507-a0f3-f050749d19c7 service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.268745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2187d-a5dc-4507-a0f3-f050749d19c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.274520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-08a2187d-a5dc-4507-a0f3-f050749d19c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.303599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1193/2387] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:48.305023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:48.312921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.347837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2187d-a5dc-4507-a0f3-f050749d19c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:48.350951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2187d-a5dc-4507-a0f3-f050749d19c7 service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:48.367436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1195/2388] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:38:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:38:48.369510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.369817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.371216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.402364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:48.404507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.416437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1196/2389] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:48.417606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:48.419462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.444721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f00f7-c0bf-444b-b705-a1fb75a387ca None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:48.455477 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e572467-c473-4cde-afb6-f942d73690e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:48.456847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e572467-c473-4cde-afb6-f942d73690e0 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.457369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e572467-c473-4cde-afb6-f942d73690e0 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.457945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e572467-c473-4cde-afb6-f942d73690e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.460748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2e572467-c473-4cde-afb6-f942d73690e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.486741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e572467-c473-4cde-afb6-f942d73690e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:48.488781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e572467-c473-4cde-afb6-f942d73690e0 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:48.510908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1194/2390] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:48.512720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9830-57f2-42a3-86ea-6be0370aec72 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.513440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9830-57f2-42a3-86ea-6be0370aec72 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.513949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9830-57f2-42a3-86ea-6be0370aec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.527957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781d82-858b-4b57-a5e2-b59ba5060588 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:48.533574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:48.534243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.534515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.534790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.546217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:48.550590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a14e9830-57f2-42a3-86ea-6be0370aec72 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:48.553435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a14e9830-57f2-42a3-86ea-6be0370aec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:48.560883 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:48.569001 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1195/2391] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:48.575363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9830-57f2-42a3-86ea-6be0370aec72 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:48.586484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:48.593928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9830-57f2-42a3-86ea-6be0370aec72 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:48.595106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1197/2392] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:48.625424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:48.626410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.627601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.627941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.629993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:38:48.630410 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:48.632989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:48.659867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1196/2393] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:38:48.663202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:48.676008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f8679-28f8-4863-aa20-006b4232c79a service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:48.685935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:48.686614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:48.686873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:48.687149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:48.687916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:48.689906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:48.786035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1198/2394] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:48 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:48.791010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:48.809707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dafd3-a409-40a9-ad5c-e8d0d39259dd admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:49.008987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:49.008987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.009970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.010528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.012060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:49.015645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:49.078255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1197/2395] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:48 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:49.078962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:49.094711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c2854-904a-422d-a637-300c3fca0cb1 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:49.102420 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:49.103363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.103861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.104332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.105232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:49.109660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:49.112668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:49.141816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1199/2396] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:49.144407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:49.160628 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede87d9-95c4-4df4-8b8e-f242a97b62b7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:49.173697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:49.175015 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.175510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.176041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.177409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:49.181520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:49.212494 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1198/2397] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:49.215012 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:49.232147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be61c68-776b-43e9-9ec7-ad94764add65 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:49.240653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb7933-b6b7-47f2-9eac-7bc23bdede19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:49.241913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb7933-b6b7-47f2-9eac-7bc23bdede19 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.242309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb7933-b6b7-47f2-9eac-7bc23bdede19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.242748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb7933-b6b7-47f2-9eac-7bc23bdede19 admin admin] PATH_INFO: `/v3/projects/eef6ad3427144be3b3ed2a90ec932111/users/9ca8048e5eba4509aa9cf75bd327ba35/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.272736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb7933-b6b7-47f2-9eac-7bc23bdede19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef6ad3427144be3b3ed2a90ec932111, user_id=9ca8048e5eba4509aa9cf75bd327ba35, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:49.275950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb7933-b6b7-47f2-9eac-7bc23bdede19 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:49.285140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:49.287278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:49.308718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161bf36-746d-46e8-a275-0955707918fd admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:49.323493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1200/2398] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:49 2022] PUT /identity/v3/projects/eef6ad3427144be3b3ed2a90ec932111/users/9ca8048e5eba4509aa9cf75bd327ba35/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:49.343212 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dae7f0-e3f3-48fd-88d2-4ddb66093623 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.344561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dae7f0-e3f3-48fd-88d2-4ddb66093623 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.346100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dae7f0-e3f3-48fd-88d2-4ddb66093623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.413104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-08dae7f0-e3f3-48fd-88d2-4ddb66093623 None None] MFA Rules not processed for user `9ca8048e5eba4509aa9cf75bd327ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:49.414981 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-08dae7f0-e3f3-48fd-88d2-4ddb66093623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:49.450583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:49.451957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.452575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.452835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] PATH_INFO: `/v3/projects/2511a9afb38e4c2eafd4e987a3eebd50` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.454987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2511a9afb38e4c2eafd4e987a3eebd50)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:49.458377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:49.564496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2511a9afb38e4c2eafd4e987a3eebd50', 'request_id': 'req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.582156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1201/2399] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:49.582489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2511a9afb38e4c2eafd4e987a3eebd50', 'request_id': 'req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.585597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dae7f0-e3f3-48fd-88d2-4ddb66093623 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:49.591785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2511a9afb38e4c2eafd4e987a3eebd50', 'request_id': 'req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.612194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:49.612497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dae7f0-e3f3-48fd-88d2-4ddb66093623 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:49.619852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] The token cache is being invalidate because project 2511a9afb38e4c2eafd4e987a3eebd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:49.620358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.621686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.631804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1199/2400] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:49 2022] DELETE /identity/v3/projects/2511a9afb38e4c2eafd4e987a3eebd50 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:49.631804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:49.634858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:49.751965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:49.753241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.753760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.754761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.757076 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:49.763077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217aef6-21dd-407b-a3a7-d2f24eaf6e2e admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:49.765603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:49.773348 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:49.774713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:49.775192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:49.776043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] PATH_INFO: `/v3/users/e9dd200ebab74714a1142d1529b497af` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:49.778632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9dd200ebab74714a1142d1529b497af)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:49.782729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:49.820516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1202/2401] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:49 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:49.827029 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:49.831959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:49.871345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9dd200ebab74714a1142d1529b497af'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.899687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9dd200ebab74714a1142d1529b497af'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.915517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9dd200ebab74714a1142d1529b497af'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.922079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9dd200ebab74714a1142d1529b497af'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.944320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9dd200ebab74714a1142d1529b497af'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:49.951047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:49.960291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1200/2402] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:49 2022] DELETE /identity/v3/users/e9dd200ebab74714a1142d1529b497af => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:49.990313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e5c8-cb24-4875-99f9-db46cf5f116d admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:50.193586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:50.193586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:50.193586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:50.193586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:50.196766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:50.200968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:50.259591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1203/2403] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:49 2022] POST /identity/v3/users => generated 299 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:38:50.260592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:50.262664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:50.286825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec029bf2-d6e7-4b15-867f-34c95da6832c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:50.310675 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:50.317655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:50.318516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:50.318966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:50.325955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:50.329067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:50.373233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1201/2404] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:38:50.380101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:50.412738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb11f4-2e8e-4323-809f-e20ab2dcb562 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:50.438221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:50.438221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:50.438221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:50.438221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] PATH_INFO: `/v3/projects/69d145c4585447a8aad4b86ef5da1162/users/f8f0ff020e8b4ed58250178a5f5b011a/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:50.472513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d145c4585447a8aad4b86ef5da1162, user_id=f8f0ff020e8b4ed58250178a5f5b011a, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:50.478985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:50.514857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1204/2405] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:50 2022] PUT /identity/v3/projects/69d145c4585447a8aad4b86ef5da1162/users/f8f0ff020e8b4ed58250178a5f5b011a/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:50.517291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:50.530821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2731-e417-4de8-bf8e-cd8fd64d1692 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:50.589817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:50.594209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:50.629592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:50.631346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:50.631966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:50.632805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:50.633569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:50.635294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:50.651549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1202/2406] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:50.657554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:50.673375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:50.683556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc1727-06c7-4946-9bf3-5cdf18eb0e1b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:50.704297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8cf2-8922-4825-a544-1528ec7f9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:50.705599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8cf2-8922-4825-a544-1528ec7f9ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:50.706132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8cf2-8922-4825-a544-1528ec7f9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:50.706670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8cf2-8922-4825-a544-1528ec7f9ce6 admin admin] PATH_INFO: `/v3/projects/69d145c4585447a8aad4b86ef5da1162/users/f8f0ff020e8b4ed58250178a5f5b011a/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:50.710496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8cf2-8922-4825-a544-1528ec7f9ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d145c4585447a8aad4b86ef5da1162, user_id=f8f0ff020e8b4ed58250178a5f5b011a, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:50.715534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8cf2-8922-4825-a544-1528ec7f9ce6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:50.738110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1203/2407] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:50 2022] PUT /identity/v3/projects/69d145c4585447a8aad4b86ef5da1162/users/f8f0ff020e8b4ed58250178a5f5b011a/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:50.753234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfaef9-d1df-4deb-b8cb-469205ff3b9d admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:50.756640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:50.757179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:50.757656 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:50.821437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] MFA Rules not processed for user `f8f0ff020e8b4ed58250178a5f5b011a`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:50.823612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:50.903642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:50.904462 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:50.904863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:50.905252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] PATH_INFO: `/v3/projects/9b9b96d9bf914d44bd52f50992929342` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:50.909474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9b96d9bf914d44bd52f50992929342)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:50.913997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:50.932898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:50.989211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1204/2408] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:51.017833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:51.020346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.046144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9b96d9bf914d44bd52f50992929342', 'request_id': 'req-47577678-b4ba-4ccf-9c26-4ed5eee5a903'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.064850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9b96d9bf914d44bd52f50992929342', 'request_id': 'req-47577678-b4ba-4ccf-9c26-4ed5eee5a903'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.081139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9b96d9bf914d44bd52f50992929342', 'request_id': 'req-47577678-b4ba-4ccf-9c26-4ed5eee5a903'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.126505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] The token cache is being invalidate because project 9b9b96d9bf914d44bd52f50992929342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:51.128244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.129529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-47577678-b4ba-4ccf-9c26-4ed5eee5a903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.133080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1205/2409] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:50 2022] DELETE /identity/v3/projects/9b9b96d9bf914d44bd52f50992929342 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:51.139049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7511c8-8b24-4153-b167-53ac11ddcdad None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.140809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7511c8-8b24-4153-b167-53ac11ddcdad None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.141339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7511c8-8b24-4153-b167-53ac11ddcdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.150607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cf401-8305-4952-a983-876021b1ae55 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:51.181206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-eb7511c8-8b24-4153-b167-53ac11ddcdad None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:51.182560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-eb7511c8-8b24-4153-b167-53ac11ddcdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.249198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:51.250522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.251201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.251796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.255054 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.314171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1206/2410] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:51.328662 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453d8f-0029-47ce-9412-3872a52be2b9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.329190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453d8f-0029-47ce-9412-3872a52be2b9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.329866 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453d8f-0029-47ce-9412-3872a52be2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.360604 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:51.364969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-25453d8f-0029-47ce-9412-3872a52be2b9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:51.369174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-25453d8f-0029-47ce-9412-3872a52be2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.387832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:51.391662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:51.391887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1207/2411] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:51.396835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453d8f-0029-47ce-9412-3872a52be2b9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:51.408619 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1205/2412] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:51.411912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453d8f-0029-47ce-9412-3872a52be2b9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:51.420780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:51.422161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.422853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.423365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.424694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:38:51.425315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:51.430659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:51.462536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:51.466852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.489806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1208/2413] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:38:51.503692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:51.512616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa697-c933-4a36-95e9-f72220160a02 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:51.524184 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:51.524915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.531183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d55c7-7474-47ee-8d47-07d30c337581 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:51.534683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.535170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] PATH_INFO: `/v3/users/9ca8048e5eba4509aa9cf75bd327ba35` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.537077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca8048e5eba4509aa9cf75bd327ba35)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:51.540561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:51.541630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:51.541815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.543386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.544103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.545487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:51.549208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:51.610176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1209/2414] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:51 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:51.616703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:51.622958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca8048e5eba4509aa9cf75bd327ba35'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.639725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca8048e5eba4509aa9cf75bd327ba35'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.650040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca8048e5eba4509aa9cf75bd327ba35'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.650827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca8048e5eba4509aa9cf75bd327ba35'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.664112 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-67c917d3-eebf-435d-b893-2e9d426533c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca8048e5eba4509aa9cf75bd327ba35'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:51.694314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1206/2415] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:51 2022] DELETE /identity/v3/users/9ca8048e5eba4509aa9cf75bd327ba35 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:51.695987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.696343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.696503 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.730865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:51.733070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.781512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:51.797209 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb692acc-d7b5-4a07-bb9e-c02c75962756 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:51.882339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1207/2416] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:51.891320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:51.893774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.928216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:51.929330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:51.929815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:51.930242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:51.931077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:51.933523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:51.972894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1210/2417] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:51 2022] POST /identity/v3/users => generated 282 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:51.974213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:51.977017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:51.996305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c920-986a-4590-bdeb-9fe887298a19 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.006153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.007167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.007670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.008148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.009390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.012436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.013582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cba5d-f4a2-4442-892e-8fd332b0c004 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.020988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.022500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.023298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.023912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.045515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.048605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.049291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1211/2418] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:52.056435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:52.065577 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:52.083670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1208/2419] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:38:52.093524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b8794-0f2b-48b8-9c43-7637821a6fce admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.103216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439b373-2e10-4701-9c52-8e6008e1e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.104762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b373-2e10-4701-9c52-8e6008e1e6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.106091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b373-2e10-4701-9c52-8e6008e1e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.106782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b373-2e10-4701-9c52-8e6008e1e6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.108222 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439b373-2e10-4701-9c52-8e6008e1e6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.111207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439b373-2e10-4701-9c52-8e6008e1e6d5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.151451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1212/2420] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:52.157212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:52.180224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac0195-ce9b-4850-94fb-732cc3d3046e service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.208222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.214563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.215040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.215592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] PATH_INFO: `/v3/projects/377ee27cc523404caddfa59f6ded82ff/users/b230deb90bd94ebb86801cee2b314c23/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.247897 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377ee27cc523404caddfa59f6ded82ff, user_id=b230deb90bd94ebb86801cee2b314c23, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.253460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.277264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1209/2421] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:52 2022] PUT /identity/v3/projects/377ee27cc523404caddfa59f6ded82ff/users/b230deb90bd94ebb86801cee2b314c23/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:52.290163 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.290932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.291590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.332313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] MFA Rules not processed for user `b230deb90bd94ebb86801cee2b314c23`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:52.334289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:52.508351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1213/2422] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:52.514876 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:52.653920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22ca1b-678c-4d3b-8a5c-cc05c862aaa0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.669638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.671088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.671723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.672488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.673998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.678982 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.711936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:52.714307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:52.741037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1210/2423] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:52 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:52.746161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b433ca-67a5-45b7-8721-aa938d180788 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.747307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:52.870211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.871739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.872280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f04c59-6e4e-41ca-9512-43bda2ce8c92 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.872775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.873616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] PATH_INFO: `/v3/projects/eef6ad3427144be3b3ed2a90ec932111` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.876663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef6ad3427144be3b3ed2a90ec932111)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.878124 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.878883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.879167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.879547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.880168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.880500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.882327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.884084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:52.925137 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1211/2424] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:52 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:52.930820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:52.948308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d1c2-c5ac-443f-b2a2-37dda32165b7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:52.957761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:52.958862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:52.959415 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:52.960521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:52.962703 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:52.965634 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:52.998604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef6ad3427144be3b3ed2a90ec932111', 'request_id': 'req-42dee4c3-28bb-4aad-81ad-4c65539d8f64'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.005922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1212/2425] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:38:53.010734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef6ad3427144be3b3ed2a90ec932111', 'request_id': 'req-42dee4c3-28bb-4aad-81ad-4c65539d8f64'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.010948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:53.035943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ee8e-c417-4c59-bbcb-dc4ea9104fa8 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:53.038460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef6ad3427144be3b3ed2a90ec932111', 'request_id': 'req-42dee4c3-28bb-4aad-81ad-4c65539d8f64'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.064466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] The token cache is being invalidate because project eef6ad3427144be3b3ed2a90ec932111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:53.065120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.066047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.071500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1214/2426] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:52 2022] DELETE /identity/v3/projects/eef6ad3427144be3b3ed2a90ec932111 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:53.072633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:53.074008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:53.125484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:53.176258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:53.176990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:53.177246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:53.177578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] PATH_INFO: `/v3/projects/7027c1061c2a4ffc96c892b44d3563ee/users/630b1f34ca3c46a3b733bd2fc072f2db/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:53.208188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7027c1061c2a4ffc96c892b44d3563ee, user_id=630b1f34ca3c46a3b733bd2fc072f2db, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:53.215908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:53.220546 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dee4c3-28bb-4aad-81ad-4c65539d8f64 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:53.245464 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:53.246480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:53.246869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:53.247472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] PATH_INFO: `/v3/users/f8f0ff020e8b4ed58250178a5f5b011a` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:53.249358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f0ff020e8b4ed58250178a5f5b011a)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:53.250006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1213/2427] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:53 2022] PUT /identity/v3/projects/7027c1061c2a4ffc96c892b44d3563ee/users/630b1f34ca3c46a3b733bd2fc072f2db/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:53.254228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:53.254631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:53.257294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:53.332194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f0ff020e8b4ed58250178a5f5b011a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.349523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f0ff020e8b4ed58250178a5f5b011a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.350471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f0ff020e8b4ed58250178a5f5b011a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.359935 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f0ff020e8b4ed58250178a5f5b011a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.368761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f0ff020e8b4ed58250178a5f5b011a'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:53.376251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1215/2428] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:53 2022] DELETE /identity/v3/users/f8f0ff020e8b4ed58250178a5f5b011a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:53.377200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8277991-df33-4ddf-91c2-3e4b181167b1 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:53.462033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9e1cb-86fd-4381-98c6-df626e1a4794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:53.463201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9e1cb-86fd-4381-98c6-df626e1a4794 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:53.463762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9e1cb-86fd-4381-98c6-df626e1a4794 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:53.464262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9e1cb-86fd-4381-98c6-df626e1a4794 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:53.465598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9e1cb-86fd-4381-98c6-df626e1a4794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:53.468069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9e1cb-86fd-4381-98c6-df626e1a4794 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:53.493807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1214/2429] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:53.499491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:53.503375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:53.536189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477e3b3-3a99-4924-9b2e-0fb64f11d55c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:53.542469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:53.544305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:53.544695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:53.545636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] PATH_INFO: `/v3/projects/7027c1061c2a4ffc96c892b44d3563ee/users/630b1f34ca3c46a3b733bd2fc072f2db/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:53.548253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7027c1061c2a4ffc96c892b44d3563ee, user_id=630b1f34ca3c46a3b733bd2fc072f2db, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:53.554126 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:53.559070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:53.570709 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1216/2430] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:53 2022] PUT /identity/v3/projects/7027c1061c2a4ffc96c892b44d3563ee/users/630b1f34ca3c46a3b733bd2fc072f2db/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:38:53.581299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:53.581810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:53.582103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:53.633600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] MFA Rules not processed for user `630b1f34ca3c46a3b733bd2fc072f2db`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:53.635578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:53.770421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:53.812362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1215/2431] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:53.836882 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:53.839323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:53.910757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:53.916470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:54.011143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941113d-0451-4e6a-88f8-daa1cc998f8f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:54.017939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c950-90f5-4a74-8f61-bb0850ba66fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:54.019636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c950-90f5-4a74-8f61-bb0850ba66fe service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:54.020122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c950-90f5-4a74-8f61-bb0850ba66fe service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:54.020567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c950-90f5-4a74-8f61-bb0850ba66fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:54.043967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c950-90f5-4a74-8f61-bb0850ba66fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:54.046626 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c950-90f5-4a74-8f61-bb0850ba66fe service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:54.066228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1217/2432] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:54.122436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fd7a-eb62-4028-86ec-e5b3c987fbc3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:54.139575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:54.140303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:54.140590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:54.140872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] PATH_INFO: `/v3/projects/69d145c4585447a8aad4b86ef5da1162` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:54.142851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d145c4585447a8aad4b86ef5da1162)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:54.146255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:54.282264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d145c4585447a8aad4b86ef5da1162', 'request_id': 'req-682e85c1-a73a-4017-b08f-de4846f3e368'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:54.290711 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d145c4585447a8aad4b86ef5da1162', 'request_id': 'req-682e85c1-a73a-4017-b08f-de4846f3e368'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:54.319770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d145c4585447a8aad4b86ef5da1162', 'request_id': 'req-682e85c1-a73a-4017-b08f-de4846f3e368'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:54.356803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] The token cache is being invalidate because project 69d145c4585447a8aad4b86ef5da1162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:54.360786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:54.362589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-682e85c1-a73a-4017-b08f-de4846f3e368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:54.367840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1216/2433] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:53 2022] DELETE /identity/v3/projects/69d145c4585447a8aad4b86ef5da1162 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:54.377764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f20a2-2a7a-4239-950e-a3e7db51aaac None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:54.378521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f20a2-2a7a-4239-950e-a3e7db51aaac None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:54.378521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f20a2-2a7a-4239-950e-a3e7db51aaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:54.438269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4e8f20a2-2a7a-4239-950e-a3e7db51aaac None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:54.440465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4e8f20a2-2a7a-4239-950e-a3e7db51aaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:54.663074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1218/2434] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:54.679422 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610c96c-c1c9-47a3-9b12-90d4b1c67fc8 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:54.680086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610c96c-c1c9-47a3-9b12-90d4b1c67fc8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:54.680455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610c96c-c1c9-47a3-9b12-90d4b1c67fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:54.731155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5610c96c-c1c9-47a3-9b12-90d4b1c67fc8 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:54.732640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5610c96c-c1c9-47a3-9b12-90d4b1c67fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:54.741699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1217/2435] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:54.746360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f20a2-2a7a-4239-950e-a3e7db51aaac None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:54.757083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f20a2-2a7a-4239-950e-a3e7db51aaac None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:54.778161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:54.780412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:54.780698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:54.780976 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:54.781693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:38:54.781998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:54.798263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:54.842752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1219/2436] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:38:54.846051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610c96c-c1c9-47a3-9b12-90d4b1c67fc8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:54.863926 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610c96c-c1c9-47a3-9b12-90d4b1c67fc8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:54.880121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:54.881005 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:54.881497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:54.882355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:54.883418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:54.887480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:54.939754 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1218/2437] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:54 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:54.944871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:54.969838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68b3e-8098-4c4e-b24c-ba74fb25bf6e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:54.992707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:54.996627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:55.094239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:55.100322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:55.101465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.101886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.102312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.103518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:55.107529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:55.132304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffa73c-d055-445e-b2cf-05f26ecea080 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:55.140732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1220/2438] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:54 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:55.140965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:55.141529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.142007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.142667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] PATH_INFO: `/v3/users/b230deb90bd94ebb86801cee2b314c23` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.143177 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:55.144836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b230deb90bd94ebb86801cee2b314c23)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:55.147773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:55.156752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59ff00-3805-410c-a339-1a1f2fee1101 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:55.162781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:55.163777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.164343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.164779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.165674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:55.167873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:55.198629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1221/2439] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:38:55.204380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:55.217777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:55.234174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3104f2-efc3-4a7b-aa62-5177285b23ac admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:55.252722 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:55.253572 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.254849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.255373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b230deb90bd94ebb86801cee2b314c23'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:55.255800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.258916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:55.261001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:55.290583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b230deb90bd94ebb86801cee2b314c23'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:55.294193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1222/2440] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:55.301704 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:55.316795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b230deb90bd94ebb86801cee2b314c23'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:55.318594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b230deb90bd94ebb86801cee2b314c23'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:55.324375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7ebf-7409-422c-a8e3-8770ea9b431c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:55.331768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:55.335493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.335493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.335493 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] PATH_INFO: `/v3/projects/26bac17a222b4866922eca2155e6629f/users/1a7a1049ca3443b8a1f726e78119aa7d/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.340331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f054d0b8-85de-44ca-9bda-20b77d7457de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b230deb90bd94ebb86801cee2b314c23'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:55.354921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1219/2441] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:54 2022] DELETE /identity/v3/users/b230deb90bd94ebb86801cee2b314c23 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:55.359941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818780c5-c437-4bf2-b355-991200b5339d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.360608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818780c5-c437-4bf2-b355-991200b5339d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.361023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818780c5-c437-4bf2-b355-991200b5339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.393291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bac17a222b4866922eca2155e6629f, user_id=1a7a1049ca3443b8a1f726e78119aa7d, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:55.397016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:55.408501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-818780c5-c437-4bf2-b355-991200b5339d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:55.410176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-818780c5-c437-4bf2-b355-991200b5339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:55.424023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1223/2442] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:55 2022] PUT /identity/v3/projects/26bac17a222b4866922eca2155e6629f/users/1a7a1049ca3443b8a1f726e78119aa7d/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:55.425243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:55.427173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:55.573887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1220/2443] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:55.575399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.575924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.576261 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.609890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c7557-dfe9-4659-b367-62dd2e3e9748 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:55.618333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:55.619869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.620401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.621482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.625369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:55.635759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] MFA Rules not processed for user `1a7a1049ca3443b8a1f726e78119aa7d`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:55.638600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:55.764814 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:55.768692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:55.793489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1224/2444] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:55.794151 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:55.802314 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:55.806412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:55.839603 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1221/2445] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:55.840423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:55.841946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:55.944134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b19771-4885-469a-94ef-a4481beea6da None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:55.949823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:55.950667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:55.951028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:55.951501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:55.971178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:55.975143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:56.000006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1222/2446] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:56.026814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:56.028942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:56.042999 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f7d4-e307-4cc2-91b2-2411a2e89d3a service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:56.055952 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4cb15-784a-40be-890d-d4758f9d1023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:56.056733 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4cb15-784a-40be-890d-d4758f9d1023 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:56.057190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4cb15-784a-40be-890d-d4758f9d1023 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:56.057649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4cb15-784a-40be-890d-d4758f9d1023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:56.147490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:56.212769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c915f7-4722-4c41-8c3a-55d768d2d65d service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:56.220867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:56.222151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:56.222912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:56.223399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] PATH_INFO: `/v3/users/1a7a1049ca3443b8a1f726e78119aa7d` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:56.225303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7a1049ca3443b8a1f726e78119aa7d)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:56.229485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:56.263823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4cb15-784a-40be-890d-d4758f9d1023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:56.266530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4cb15-784a-40be-890d-d4758f9d1023 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:56.294685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1225/2447] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:56.323399 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7a1049ca3443b8a1f726e78119aa7d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:56.345407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7a1049ca3443b8a1f726e78119aa7d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:56.361905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7a1049ca3443b8a1f726e78119aa7d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:56.364918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7a1049ca3443b8a1f726e78119aa7d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:56.394720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7a1049ca3443b8a1f726e78119aa7d'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:56.412396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1223/2448] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:56 2022] DELETE /identity/v3/users/1a7a1049ca3443b8a1f726e78119aa7d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:56.417917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:56.421049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:56.421587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:56.470531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:56.470531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:56.625590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1226/2449] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:56.641686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:56.643544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:56.719965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:56.794336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6d7d-a375-482b-ba5b-db2f985570fa admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:56.801231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:56.802263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:56.803009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:56.803475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:56.815671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:56.817346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:56.839520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1224/2450] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:56.919738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:56.922080 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:56.977244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7862d-1b06-4cd3-b4a6-fc86cd307d19 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:56.984680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:56.985479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:56.985877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:56.986273 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] PATH_INFO: `/v3/projects/377ee27cc523404caddfa59f6ded82ff` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:56.988048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=377ee27cc523404caddfa59f6ded82ff)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:56.990517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:57.083349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377ee27cc523404caddfa59f6ded82ff', 'request_id': 'req-2aade0a4-c04f-467d-8dbc-74037af0afd6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.108918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377ee27cc523404caddfa59f6ded82ff', 'request_id': 'req-2aade0a4-c04f-467d-8dbc-74037af0afd6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.140410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377ee27cc523404caddfa59f6ded82ff', 'request_id': 'req-2aade0a4-c04f-467d-8dbc-74037af0afd6'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.161412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] The token cache is being invalidate because project 377ee27cc523404caddfa59f6ded82ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:57.161783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.165785 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.179712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1227/2451] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:56 2022] DELETE /identity/v3/projects/377ee27cc523404caddfa59f6ded82ff => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:57.185963 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:57.208378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c7dbd-d6a1-4bd0-bcbf-b924545fdf19 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:57.376489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:57.379167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:57.379884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:57.382088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] PATH_INFO: `/v3/users/630b1f34ca3c46a3b733bd2fc072f2db` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:57.384474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=630b1f34ca3c46a3b733bd2fc072f2db)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:57.387260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:57.411597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:57.412419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:57.431088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aade0a4-c04f-467d-8dbc-74037af0afd6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:57.443343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:57.444486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:57.444486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:57.444700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] PATH_INFO: `/v3/projects/26bac17a222b4866922eca2155e6629f` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:57.445851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bac17a222b4866922eca2155e6629f)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:57.447855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:57.486176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630b1f34ca3c46a3b733bd2fc072f2db'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.515062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630b1f34ca3c46a3b733bd2fc072f2db'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.525041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:57.532837 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630b1f34ca3c46a3b733bd2fc072f2db'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.534350 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630b1f34ca3c46a3b733bd2fc072f2db'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.545551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bac17a222b4866922eca2155e6629f', 'request_id': 'req-1828e2ca-aa73-4352-968c-6b9da0905490'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.557335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bac17a222b4866922eca2155e6629f', 'request_id': 'req-1828e2ca-aa73-4352-968c-6b9da0905490'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.559660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-10b12aaf-6856-44d4-be78-4aeef2e822cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630b1f34ca3c46a3b733bd2fc072f2db'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.569384 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bac17a222b4866922eca2155e6629f', 'request_id': 'req-1828e2ca-aa73-4352-968c-6b9da0905490'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.572377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1225/2452] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:38:57 2022] DELETE /identity/v3/users/630b1f34ca3c46a3b733bd2fc072f2db => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:57.587007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] The token cache is being invalidate because project 26bac17a222b4866922eca2155e6629f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:57.587529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.588389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1828e2ca-aa73-4352-968c-6b9da0905490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:57.595176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1228/2453] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:57 2022] DELETE /identity/v3/projects/26bac17a222b4866922eca2155e6629f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:57.599890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51b8b8-4d58-4b32-a2a1-2a2f0d6d6e7e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:57.600092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51b8b8-4d58-4b32-a2a1-2a2f0d6d6e7e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:57.600290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51b8b8-4d58-4b32-a2a1-2a2f0d6d6e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:57.648418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ac51b8b8-4d58-4b32-a2a1-2a2f0d6d6e7e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:57.651003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ac51b8b8-4d58-4b32-a2a1-2a2f0d6d6e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:57.790455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:57.871481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1226/2454] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:57.877593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204f77-1703-4f9e-9e7f-10ef4716399b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:57.878429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204f77-1703-4f9e-9e7f-10ef4716399b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:57.879106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204f77-1703-4f9e-9e7f-10ef4716399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:57.934132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-22204f77-1703-4f9e-9e7f-10ef4716399b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:57.937118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-22204f77-1703-4f9e-9e7f-10ef4716399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:57.958006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1229/2455] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:57.962835 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51b8b8-4d58-4b32-a2a1-2a2f0d6d6e7e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:57.996289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51b8b8-4d58-4b32-a2a1-2a2f0d6d6e7e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:58.039731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:58.041241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.041768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.042346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.044019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:38:58.044510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:58.057157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:58.097338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1227/2456] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:38:58.100296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22204f77-1703-4f9e-9e7f-10ef4716399b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:58.126431 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22204f77-1703-4f9e-9e7f-10ef4716399b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:58.137288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:58.137962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.138270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.138549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.139294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:58.150732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:58.188685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:58.192417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:58.238673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1230/2457] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:58 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:58.245811 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:58.251107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d3884-e610-4b05-a484-edfea549fccc admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:58.424446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:58.430118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.430950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.433393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] PATH_INFO: `/v3/projects/7027c1061c2a4ffc96c892b44d3563ee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.437642 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7027c1061c2a4ffc96c892b44d3563ee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:58.441902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:58.518834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a45c-35b2-415c-a5a5-e5b53d838fcc admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:58.540370 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:58.541375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.541696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.541953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.542627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:58.550105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:58.580788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7027c1061c2a4ffc96c892b44d3563ee', 'request_id': 'req-f50ae748-9a91-4948-9f31-3050e4116cc1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:58.604761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7027c1061c2a4ffc96c892b44d3563ee', 'request_id': 'req-f50ae748-9a91-4948-9f31-3050e4116cc1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:58.625834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1231/2458] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:58 2022] POST /identity/v3/users => generated 288 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:58.628080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7027c1061c2a4ffc96c892b44d3563ee', 'request_id': 'req-f50ae748-9a91-4948-9f31-3050e4116cc1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:58.628980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:58.656747 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] The token cache is being invalidate because project 7027c1061c2a4ffc96c892b44d3563ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:38:58.657045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:58.659412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf069-0f0e-437a-826b-362aa25158f0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:58.664832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f50ae748-9a91-4948-9f31-3050e4116cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:38:58.668271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1228/2459] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:38:58 2022] DELETE /identity/v3/projects/7027c1061c2a4ffc96c892b44d3563ee => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:58.675713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffbbea-937f-497d-82bd-90abd2878f13 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.676383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffbbea-937f-497d-82bd-90abd2878f13 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.677182 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffbbea-937f-497d-82bd-90abd2878f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.717848 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-48ffbbea-937f-497d-82bd-90abd2878f13 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:58.719959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-48ffbbea-937f-497d-82bd-90abd2878f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:58.785503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:58.786941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.787307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.795745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.797374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:58.800485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:58.833747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1232/2460] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:58.840011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:58.845841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:58.869450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952e6f-350f-407c-9470-069199ab9ae9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:58.878316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:58.879609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.880194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.880772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.882093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:58.885501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:58.909566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1233/2461] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:38:58.915696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:58.930800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77858d63-3ff0-427d-91e6-bf8329fdb497 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:58.937916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e825-8791-4fac-8d2f-9a27c8f2983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:58.938838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e825-8791-4fac-8d2f-9a27c8f2983a admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.939262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e825-8791-4fac-8d2f-9a27c8f2983a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.939607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e825-8791-4fac-8d2f-9a27c8f2983a admin admin] PATH_INFO: `/v3/projects/2e6461ea6bae4fcc898ca3ad15bb74d4/users/2ce8e4b05ddb44c1865de6ae0827c738/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.940207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1229/2462] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:58.943165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae238-125d-40ae-a143-71f8f1471787 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:58.944127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae238-125d-40ae-a143-71f8f1471787 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:58.944316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae238-125d-40ae-a143-71f8f1471787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:58.962430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:58.964469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:58.985212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ce5ae238-125d-40ae-a143-71f8f1471787 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:58.986568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ce5ae238-125d-40ae-a143-71f8f1471787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:58.987272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9e825-8791-4fac-8d2f-9a27c8f2983a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6461ea6bae4fcc898ca3ad15bb74d4, user_id=2ce8e4b05ddb44c1865de6ae0827c738, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.005837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9e825-8791-4fac-8d2f-9a27c8f2983a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.008934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1230/2463] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:38:59.016528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae238-125d-40ae-a143-71f8f1471787 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:59.056513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae238-125d-40ae-a143-71f8f1471787 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:59.069826 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1234/2464] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:58 2022] PUT /identity/v3/projects/2e6461ea6bae4fcc898ca3ad15bb74d4/users/2ce8e4b05ddb44c1865de6ae0827c738/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:59.088167 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.088750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.089229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.152219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] MFA Rules not processed for user `2ce8e4b05ddb44c1865de6ae0827c738`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:38:59.153547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:59.206630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:59.207543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.208019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.208387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.209474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:38:59.210152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.212763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.250800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1231/2465] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:38:59.258140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:59.275260 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b45d28-6e4c-4f1c-a12c-8e92e1e9a191 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:59.283991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:59.285036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.285567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.285951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.287127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.292996 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.360788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1235/2466] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:38:59.373104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:59.376033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1232/2467] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:38:59 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:38:59.376730 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:38:59.383723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:59.537267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13664ff7-e764-424e-85ad-00dc40346380 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:59.556629 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c087-9e10-4ccc-bebe-e4446834fd96 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:59.577172 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:59.577810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.578070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.578673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.579029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.589292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.658327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1233/2468] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:38:59 2022] POST /identity/v3/users => generated 291 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:38:59.659062 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:59.691680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9a34e-9dce-4f50-b2b6-67713ab129a4 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:59.706585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:59.707851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.708036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.708338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.708948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.717126 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.721145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0bf6f-4b1a-488c-82c2-b63c6c7764a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:59.721989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bf6f-4b1a-488c-82c2-b63c6c7764a7 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.722258 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bf6f-4b1a-488c-82c2-b63c6c7764a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.722746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bf6f-4b1a-488c-82c2-b63c6c7764a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.739761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1234/2469] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:59.742888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:59.790227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e597cf-77a8-4df5-951e-9564ffebe858 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:59.811718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:59.812933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.813251 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.813555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.817206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.819313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.859377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1235/2470] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:38:59.861875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:38:59.865500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:59.880303 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7b02-c841-4260-9f94-62e1047541a2 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:38:59.891108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:38:59.892327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.893313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0bf6f-4b1a-488c-82c2-b63c6c7764a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.894915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0bf6f-4b1a-488c-82c2-b63c6c7764a7 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.895396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.895815 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] PATH_INFO: `/v3/projects/62db559be8774698bcd8bee1f98e89ac/users/a7e21725b2644e988aad47832945d5fe/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:38:59.913070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1236/2471] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:38:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:38:59.925990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62db559be8774698bcd8bee1f98e89ac, user_id=a7e21725b2644e988aad47832945d5fe, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:38:59.929918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:38:59.979741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1236/2472] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:38:59 2022] PUT /identity/v3/projects/62db559be8774698bcd8bee1f98e89ac/users/a7e21725b2644e988aad47832945d5fe/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:38:59.985202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f435-b919-4d3d-9787-a5ee4e90ff3c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:38:59.985673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f435-b919-4d3d-9787-a5ee4e90ff3c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:38:59.986155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f435-b919-4d3d-9787-a5ee4e90ff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:00.086918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5b52f435-b919-4d3d-9787-a5ee4e90ff3c None None] MFA Rules not processed for user `a7e21725b2644e988aad47832945d5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:00.088568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5b52f435-b919-4d3d-9787-a5ee4e90ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:00.371255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1237/2473] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:38:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:00.372763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:00.403392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:00.557915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28326f86-e1aa-43e0-813a-3d24b18270a2 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:00.575173 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:00.576023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:00.576404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:00.576781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:00.577565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:00.579775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:00.672631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1237/2474] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:00 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:00.678637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52f435-b919-4d3d-9787-a5ee4e90ff3c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:00.699238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52f435-b919-4d3d-9787-a5ee4e90ff3c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:00.809721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:00.810857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:00.811364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:00.811911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:00.813344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:00.817165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:00.863777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:00.866123 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1238/2475] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:00 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:00.883332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf572e-11f3-4439-8271-bcbbc2f20cb5 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:00.892860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:00.903881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:00.904493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:00.904875 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:00.906104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:00.909080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:00.955767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1238/2476] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:00.965713 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:00.988225 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537034c-aeb6-4d03-814d-3e37d581c211 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:01.000567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:01.002461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:01.003176 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:01.003506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] PATH_INFO: `/v3/projects/74bc1f6598634b2d937a93b30ab638c5/users/8b7e3142b6d94eeaac69c3d3fc6c3943/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:01.070480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bc1f6598634b2d937a93b30ab638c5, user_id=8b7e3142b6d94eeaac69c3d3fc6c3943, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:01.076524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:01.125215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1239/2477] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:00 2022] PUT /identity/v3/projects/74bc1f6598634b2d937a93b30ab638c5/users/8b7e3142b6d94eeaac69c3d3fc6c3943/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:01.129601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:01.153197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb3b53-a209-41e6-84ea-ad514c121199 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:01.261695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4ec48-1d97-4d74-bab2-aac0fc49be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:01.262453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ec48-1d97-4d74-bab2-aac0fc49be96 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:01.262881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ec48-1d97-4d74-bab2-aac0fc49be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:01.263279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ec48-1d97-4d74-bab2-aac0fc49be96 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:01.264786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4ec48-1d97-4d74-bab2-aac0fc49be96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:01.268396 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4ec48-1d97-4d74-bab2-aac0fc49be96 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:01.290646 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1239/2478] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:01.297747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:01.314229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015a7b6-25b1-4282-8a18-b4f394bea484 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:01.321745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:01.323301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:01.323819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:01.324433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] PATH_INFO: `/v3/projects/74bc1f6598634b2d937a93b30ab638c5/users/8b7e3142b6d94eeaac69c3d3fc6c3943/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:01.330655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bc1f6598634b2d937a93b30ab638c5, user_id=8b7e3142b6d94eeaac69c3d3fc6c3943, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:01.336595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:01.363063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1240/2479] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:01 2022] PUT /identity/v3/projects/74bc1f6598634b2d937a93b30ab638c5/users/8b7e3142b6d94eeaac69c3d3fc6c3943/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:01.374723 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768dd3-5659-4fe9-95b7-48204a119f34 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:01.375031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768dd3-5659-4fe9-95b7-48204a119f34 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:01.375291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768dd3-5659-4fe9-95b7-48204a119f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:01.418412 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2d768dd3-5659-4fe9-95b7-48204a119f34 None None] MFA Rules not processed for user `8b7e3142b6d94eeaac69c3d3fc6c3943`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:01.419871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2d768dd3-5659-4fe9-95b7-48204a119f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:01.560565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1240/2480] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:01.573917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:01.661477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:01.769786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be889b3-0db3-4928-b245-fde9ace19169 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:01.787160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:01.788096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:01.788503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:01.788898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:01.807174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:01.809173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:01.825043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1241/2481] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:02.789940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d768dd3-5659-4fe9-95b7-48204a119f34 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:02.800003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d768dd3-5659-4fe9-95b7-48204a119f34 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:02.805340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7e3142b6d94eeaac69c3d3fc6c3943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74bc1f6598634b2d937a93b30ab638c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:02.806219 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:02.806524 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:02.807004 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:02.807981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:02.808288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:02.810162 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:02.812871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:02.836429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1241/2482] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:02.843556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:02.855508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce9dee-be5f-4e97-b5a4-e887a72f8d04 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:02.861499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7e3142b6d94eeaac69c3d3fc6c3943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74bc1f6598634b2d937a93b30ab638c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:02.862213 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:02.862541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:02.864016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:02.864016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:02.866387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:02.906263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1242/2483] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:02 2022] POST /identity/v3/projects => generated 352 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:02.909512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:02.927314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b88b8-5d22-4819-93d3-e4bddb613141 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:03.030825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7e3142b6d94eeaac69c3d3fc6c3943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74bc1f6598634b2d937a93b30ab638c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:03.031899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:03.032193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:03.032643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:03.033491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:03.033808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:03.036707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:03.056840 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1242/2484] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:39:03.125046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:03.148407 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9cf10-9100-41cc-88ab-153bf972b21e tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:03.159847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7e3142b6d94eeaac69c3d3fc6c3943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74bc1f6598634b2d937a93b30ab638c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:03.161143 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:03.163055 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:03.163657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] PATH_INFO: `/v3/projects/421225fccfa54c06bf3bc9c1987cf871` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:03.166631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorizing `identity:delete_project(project_id=421225fccfa54c06bf3bc9c1987cf871)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:03.170961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:03.249908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421225fccfa54c06bf3bc9c1987cf871', 'request_id': 'req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.258728 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421225fccfa54c06bf3bc9c1987cf871', 'request_id': 'req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.275557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421225fccfa54c06bf3bc9c1987cf871', 'request_id': 'req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.295204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] The token cache is being invalidate because project 421225fccfa54c06bf3bc9c1987cf871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:03.295204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.295204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.296746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1243/2485] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:03 2022] DELETE /identity/v3/projects/421225fccfa54c06bf3bc9c1987cf871 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:03.610855 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:03.613129 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:03.665490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:03.667039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:03.737756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6d390-4bdf-4ba1-94cb-0c3ceb1fa616 tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:03.771858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2865f-b263-4c8a-9cdf-0e3952496cfa tempest-VolumeQuotaClassesTest-552096795 tempest-VolumeQuotaClassesTest-552096795-project-admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:03.776453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483919db-fd0c-4817-b509-9afcfa8e835b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:03.777466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483919db-fd0c-4817-b509-9afcfa8e835b service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:03.777871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483919db-fd0c-4817-b509-9afcfa8e835b service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:03.778295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483919db-fd0c-4817-b509-9afcfa8e835b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:03.780839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-483919db-fd0c-4817-b509-9afcfa8e835b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:03.793918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483919db-fd0c-4817-b509-9afcfa8e835b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:03.795943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483919db-fd0c-4817-b509-9afcfa8e835b service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:03.806838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1244/2486] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:03.833731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:03.834523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:03.834696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:03.834881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] PATH_INFO: `/v3/users/a7e21725b2644e988aad47832945d5fe` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:03.836268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e21725b2644e988aad47832945d5fe)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:03.838332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:03.912887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:03.937901 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e21725b2644e988aad47832945d5fe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.962018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e21725b2644e988aad47832945d5fe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.979433 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e21725b2644e988aad47832945d5fe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.981823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e21725b2644e988aad47832945d5fe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:03.999107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e21725b2644e988aad47832945d5fe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:04.011650 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1243/2487] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:03 2022] DELETE /identity/v3/users/a7e21725b2644e988aad47832945d5fe => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:04.018285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:04.018983 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:04.019474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:04.070201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:04.072813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:04.144148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:04.204910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1245/2488] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:04.225109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:04.227681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:04.342632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32235e3-35ed-40e5-acea-8cd5e6f100c4 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:04.350395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:04.351464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:04.351999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:04.352416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:04.373680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:04.376620 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:04.395769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1244/2489] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:04.898700 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:04.901130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:04.921291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70847d3-7b64-4d07-870e-37e00e0131f0 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:04.928575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:04.930049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:04.930513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:04.931102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] PATH_INFO: `/v3/projects/62db559be8774698bcd8bee1f98e89ac` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:04.933093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62db559be8774698bcd8bee1f98e89ac)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:04.935859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:05.019350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62db559be8774698bcd8bee1f98e89ac', 'request_id': 'req-ed785ac4-9dd9-4035-9c4b-50fa07437519'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.030476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62db559be8774698bcd8bee1f98e89ac', 'request_id': 'req-ed785ac4-9dd9-4035-9c4b-50fa07437519'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.042946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62db559be8774698bcd8bee1f98e89ac', 'request_id': 'req-ed785ac4-9dd9-4035-9c4b-50fa07437519'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.060683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] The token cache is being invalidate because project 62db559be8774698bcd8bee1f98e89ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:05.061016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.061800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.063541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1246/2490] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:04 2022] DELETE /identity/v3/projects/62db559be8774698bcd8bee1f98e89ac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:05.068326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:05.080774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3824b1-eaa9-486d-894e-0c25179e32ab service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:05.158833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:05.166882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:05.167171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:05.167530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] PATH_INFO: `/v3/users/8b7e3142b6d94eeaac69c3d3fc6c3943` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:05.169195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7e3142b6d94eeaac69c3d3fc6c3943)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:05.171344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:05.250146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7e3142b6d94eeaac69c3d3fc6c3943'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.261223 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:05.271744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7e3142b6d94eeaac69c3d3fc6c3943'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.283306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7e3142b6d94eeaac69c3d3fc6c3943'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.284331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7e3142b6d94eeaac69c3d3fc6c3943'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.294664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7b19f15c-de4a-4339-a37b-0a31510640d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7e3142b6d94eeaac69c3d3fc6c3943'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:05.303355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1245/2491] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:05 2022] DELETE /identity/v3/users/8b7e3142b6d94eeaac69c3d3fc6c3943 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:05.741102 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:05.743506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:05.760757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed785ac4-9dd9-4035-9c4b-50fa07437519 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:05.916946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:05.917655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:05.917942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:05.918262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] PATH_INFO: `/v3/projects/74bc1f6598634b2d937a93b30ab638c5` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:05.919550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bc1f6598634b2d937a93b30ab638c5)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:05.921549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:06.022926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bc1f6598634b2d937a93b30ab638c5', 'request_id': 'req-066952d6-314d-4d86-a710-ffdecf9733c8'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:06.039175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bc1f6598634b2d937a93b30ab638c5', 'request_id': 'req-066952d6-314d-4d86-a710-ffdecf9733c8'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:06.053468 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:06.060945 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bc1f6598634b2d937a93b30ab638c5', 'request_id': 'req-066952d6-314d-4d86-a710-ffdecf9733c8'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:06.098547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] The token cache is being invalidate because project 74bc1f6598634b2d937a93b30ab638c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:06.099680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:06.101452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-066952d6-314d-4d86-a710-ffdecf9733c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:06.103565 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1247/2492] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:05 2022] DELETE /identity/v3/projects/74bc1f6598634b2d937a93b30ab638c5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:06.125466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3d08-397f-4199-944e-0da96a3794b4 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:06.126087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3d08-397f-4199-944e-0da96a3794b4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:06.126431 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3d08-397f-4199-944e-0da96a3794b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:06.208360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-727d3d08-397f-4199-944e-0da96a3794b4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:06.214186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-727d3d08-397f-4199-944e-0da96a3794b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:06.446046 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1246/2493] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:06.464652 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540464-01b5-4517-ae5e-1f8fde9a680a None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:06.464978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540464-01b5-4517-ae5e-1f8fde9a680a None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:06.465429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540464-01b5-4517-ae5e-1f8fde9a680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:06.492989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-cf540464-01b5-4517-ae5e-1f8fde9a680a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:06.494772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-cf540464-01b5-4517-ae5e-1f8fde9a680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:06.516488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1248/2494] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:06.524660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d3d08-397f-4199-944e-0da96a3794b4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:06.545174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d3d08-397f-4199-944e-0da96a3794b4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:06.554099 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:06.555212 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:06.555800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:06.556290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:06.557418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:06.557991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:06.561341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:06.593510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540464-01b5-4517-ae5e-1f8fde9a680a None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:06.593822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1247/2495] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:06.612412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540464-01b5-4517-ae5e-1f8fde9a680a None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:06.622474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:06.623603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:06.624640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:06.625182 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:06.626605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:06.630561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:06.704441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1249/2496] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:06 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:06.711029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:06.728560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b24c7-c19c-4149-918b-07427ce19014 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:06.850582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:06.851294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:06.851583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:06.851905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:06.852677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:06.854786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:06.890707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1248/2497] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:06 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:06.895433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:06.908864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30c81-d305-4c6a-80cb-688330b1bf0f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:06.916606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:06.917670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:06.918298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:06.918644 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:06.919986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:06.923304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:06.938962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1250/2498] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:06.945576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:06.965599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdc753-90ee-4457-ad54-7c3a6f5f82e0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:06.975194 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcbd38-4478-41c2-8f0f-ee4a365f51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:06.976389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcbd38-4478-41c2-8f0f-ee4a365f51f0 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:06.976966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcbd38-4478-41c2-8f0f-ee4a365f51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:06.977453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcbd38-4478-41c2-8f0f-ee4a365f51f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:06.978716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcbd38-4478-41c2-8f0f-ee4a365f51f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:06.981014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcbd38-4478-41c2-8f0f-ee4a365f51f0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:07.002032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1249/2499] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:07.007415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:07.020734 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834fb1-7d1d-472e-b69c-d577debd42e6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:07.026065 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:07.027067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.027256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.027426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] PATH_INFO: `/v3/projects/bd54e91fab274042bda3581715952790/users/9e5ff9a97a0d465e9853882eeab521fe/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.047057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54e91fab274042bda3581715952790, user_id=9e5ff9a97a0d465e9853882eeab521fe, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:07.050275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:07.068423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1251/2500] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:07 2022] PUT /identity/v3/projects/bd54e91fab274042bda3581715952790/users/9e5ff9a97a0d465e9853882eeab521fe/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:07.080558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385cb5-4316-4ef1-a26e-5584cb4787d5 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.080943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385cb5-4316-4ef1-a26e-5584cb4787d5 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.081253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385cb5-4316-4ef1-a26e-5584cb4787d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.125227 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-dd385cb5-4316-4ef1-a26e-5584cb4787d5 None None] MFA Rules not processed for user `9e5ff9a97a0d465e9853882eeab521fe`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:07.126975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dd385cb5-4316-4ef1-a26e-5584cb4787d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:07.184441 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:07.255309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1250/2501] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:07.262136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:07.393649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32a223-ac85-4ffd-9b16-85450912fd1e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:07.401518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:07.402512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.403035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.403393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.404358 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:07.413853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:07.471391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1252/2502] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:07 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:07.475771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd385cb5-4316-4ef1-a26e-5584cb4787d5 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:07.491151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd385cb5-4316-4ef1-a26e-5584cb4787d5 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:07.587516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:07.589084 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.589418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.589899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.590746 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:07.592882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:07.640344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1251/2503] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:07 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:07.642400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:07.653950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491501d9-d6a6-4b3e-bfbc-03564978bc89 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:07.659503 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:07.660388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.660784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.661392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.662275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:07.664424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:07.686135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1253/2504] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:07.690281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:07.701927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc03693-6073-479a-a5b1-7a86dd2cd5cf admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:07.707561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3f1ce-421e-454e-8290-da7b2f17f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:07.709264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3f1ce-421e-454e-8290-da7b2f17f13e admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.709264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3f1ce-421e-454e-8290-da7b2f17f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.709264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3f1ce-421e-454e-8290-da7b2f17f13e admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.709725 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3f1ce-421e-454e-8290-da7b2f17f13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:07.711290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3f1ce-421e-454e-8290-da7b2f17f13e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:07.724014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1252/2505] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:07.729179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:07.745294 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e2c0a-fcf8-4d24-9a1d-cbb4d0776349 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:07.753919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:07.754748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.755115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.755382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] PATH_INFO: `/v3/projects/dcddf61c6ed84692bb1d3c6eb21960e2/users/2f0c0d4f723a441bbc28e5ebcc7f8505/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.781625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcddf61c6ed84692bb1d3c6eb21960e2, user_id=2f0c0d4f723a441bbc28e5ebcc7f8505, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:07.788793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:07.823768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1254/2506] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:07 2022] PUT /identity/v3/projects/dcddf61c6ed84692bb1d3c6eb21960e2/users/2f0c0d4f723a441bbc28e5ebcc7f8505/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:07.844190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e78d8-7835-4fef-b436-c0376f173014 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:07.844936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e78d8-7835-4fef-b436-c0376f173014 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:07.845413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e78d8-7835-4fef-b436-c0376f173014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:07.898681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-582e78d8-7835-4fef-b436-c0376f173014 None None] MFA Rules not processed for user `2f0c0d4f723a441bbc28e5ebcc7f8505`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:07.900206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-582e78d8-7835-4fef-b436-c0376f173014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:08.110844 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1253/2507] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:08.116275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:08.192596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:08.291405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0f71-c2ed-460b-a49f-3b92b5b1d339 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:08.309351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:08.310013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:08.310423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:08.310590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:08.311275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:08.313394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:08.352344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1255/2508] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:08 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:08.360130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e78d8-7835-4fef-b436-c0376f173014 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:08.422778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e78d8-7835-4fef-b436-c0376f173014 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:08.499326 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:08.531398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:08.532295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:08.532590 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:08.532869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:08.533570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:08.535770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:08.561616 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1254/2509] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:08 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:08.568524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:08.585473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed7a3f-1390-4449-85c4-355ecb0b0683 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:08.592635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:08.593739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:08.594192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:08.594675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:08.596131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:08.599245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:08.627868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1256/2510] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:08.629136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:08.664557 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45a35-2fe9-4d8b-b690-ef31bb028949 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:08.693293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:08.694808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:08.695183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:08.695777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] PATH_INFO: `/v3/projects/3f585b8d353f45e989503ee291b1104a/users/f1a283ad095247978d9b085dfdba8fa2/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:08.752695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f585b8d353f45e989503ee291b1104a, user_id=f1a283ad095247978d9b085dfdba8fa2, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:08.761451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:08.818018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:08.818798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1255/2511] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:08 2022] PUT /identity/v3/projects/3f585b8d353f45e989503ee291b1104a/users/f1a283ad095247978d9b085dfdba8fa2/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:08.834285 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08383266-5854-450b-89f7-c2d08436a003 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:08.989504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5173ae-bf75-4d5d-bbb8-2e3203a2abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:08.990665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5173ae-bf75-4d5d-bbb8-2e3203a2abe5 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:08.991347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5173ae-bf75-4d5d-bbb8-2e3203a2abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:08.991917 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5173ae-bf75-4d5d-bbb8-2e3203a2abe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:09.001625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5173ae-bf75-4d5d-bbb8-2e3203a2abe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:09.007963 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5173ae-bf75-4d5d-bbb8-2e3203a2abe5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:09.052824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1257/2512] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:09.057159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:09.076308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da296a76-6fb0-490b-91f9-0122c07bc74b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:09.081766 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:09.082428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:09.082613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:09.082914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] PATH_INFO: `/v3/projects/3f585b8d353f45e989503ee291b1104a/users/f1a283ad095247978d9b085dfdba8fa2/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:09.085370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f585b8d353f45e989503ee291b1104a, user_id=f1a283ad095247978d9b085dfdba8fa2, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:09.090569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:09.110839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1256/2513] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:09 2022] PUT /identity/v3/projects/3f585b8d353f45e989503ee291b1104a/users/f1a283ad095247978d9b085dfdba8fa2/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:09.126756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:09.127304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:09.127592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:09.165289 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] MFA Rules not processed for user `f1a283ad095247978d9b085dfdba8fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:09.166861 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:09.368374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1258/2514] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:09.390224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:09.395530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:09.543713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dbeb8-25a4-403f-bfed-35d5a4101897 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:09.550902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:09.551786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:09.552489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:09.552791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:09.660800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:09.663374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:09.678452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1257/2515] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:11.341956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:11.344413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:11.402634 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:11.448283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0ae6-3cae-42c8-9e8e-c1d87ceb0755 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:11.452429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:11.452872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:11.453215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:11.453405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:11.455791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:11.468026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:11.469495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:11.480079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1259/2516] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:11.978852 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:11.981096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:12.001862 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec4406-e0c8-4fef-87b0-2f37e0c03b6b service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:12.007948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:12.008834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:12.009192 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:12.009751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:12.061569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:12.064308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:12.094858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:12.113932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:12.115948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:12.128968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1258/2517] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:12.193105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f3c81-f0d5-4bb7-b54b-32b56f0674c9 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:12.201075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697116a-ac07-4553-8023-5f1e6733f7a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:12.201717 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697116a-ac07-4553-8023-5f1e6733f7a8 service placement] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:12.202002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697116a-ac07-4553-8023-5f1e6733f7a8 service placement] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:12.202276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697116a-ac07-4553-8023-5f1e6733f7a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:12.204466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f697116a-ac07-4553-8023-5f1e6733f7a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:12.218365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697116a-ac07-4553-8023-5f1e6733f7a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:12.220298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697116a-ac07-4553-8023-5f1e6733f7a8 service placement] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:12.233164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1260/2518] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:13.178310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:13.189080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4691d9-dab3-4982-9445-db857ab679e5 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:13.201337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d48c4-bff0-4df8-8832-5d7563ae8691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:13.202752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d48c4-bff0-4df8-8832-5d7563ae8691 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:13.203664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d48c4-bff0-4df8-8832-5d7563ae8691 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:13.205301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d48c4-bff0-4df8-8832-5d7563ae8691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:13.228944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d48c4-bff0-4df8-8832-5d7563ae8691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:13.230907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d48c4-bff0-4df8-8832-5d7563ae8691 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:13.254375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1259/2519] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:13.803788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71de6-6f02-4f95-be1b-0545f6a43164 None None] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:13.804601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71de6-6f02-4f95-be1b-0545f6a43164 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:13.804601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71de6-6f02-4f95-be1b-0545f6a43164 None None] PATH_INFO: `/` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:13.806362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1261/2520] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:39:13.814796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd00-ed28-48e8-846b-d0bacc539bb9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:13.816210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd00-ed28-48e8-846b-d0bacc539bb9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:13.817563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd00-ed28-48e8-846b-d0bacc539bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:13.862020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cec6bd00-ed28-48e8-846b-d0bacc539bb9 None None] MFA Rules not processed for user `c206251915e74dba98b9422cf2f026d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:13.864437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cec6bd00-ed28-48e8-846b-d0bacc539bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:13.882264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1260/2521] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:39:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:13.905296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d71de6-6f02-4f95-be1b-0545f6a43164 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:13.908847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-14d71de6-6f02-4f95-be1b-0545f6a43164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:13.933410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d71de6-6f02-4f95-be1b-0545f6a43164 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:13.938007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52671e-7dbe-4663-9ed0-a2f34f7cd7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:13.938931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52671e-7dbe-4663-9ed0-a2f34f7cd7ba service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:13.939335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52671e-7dbe-4663-9ed0-a2f34f7cd7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:13.940390 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52671e-7dbe-4663-9ed0-a2f34f7cd7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:13.951490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52671e-7dbe-4663-9ed0-a2f34f7cd7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:13.953406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52671e-7dbe-4663-9ed0-a2f34f7cd7ba service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:13.963646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1262/2522] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:14.106148 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ecbd-6da1-4fc5-b357-8fa448474d2c None None] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:14.106816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ecbd-6da1-4fc5-b357-8fa448474d2c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:14.107304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ecbd-6da1-4fc5-b357-8fa448474d2c None None] PATH_INFO: `/` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:14.109735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1261/2523] 10.222.0.58 () {54 vars in 921 bytes} [Thu Jul 28 06:39:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:39:14.118288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:14.118680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:14.118968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:14.154471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] MFA Rules not processed for user `f1b5bd02365348098c1e7b448a996f12`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:14.156570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:14.285408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1263/2524] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Jul 28 06:39:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:14.298740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300ecbd-6da1-4fc5-b357-8fa448474d2c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:14.313104 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300ecbd-6da1-4fc5-b357-8fa448474d2c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:14.319144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f1f0-2e91-43d7-a358-774b9e946f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:14.320156 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f1f0-2e91-43d7-a358-774b9e946f5f service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:14.320593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f1f0-2e91-43d7-a358-774b9e946f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:14.321026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f1f0-2e91-43d7-a358-774b9e946f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:14.344713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f1f0-2e91-43d7-a358-774b9e946f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:14.346592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f1f0-2e91-43d7-a358-774b9e946f5f service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:14.365125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1262/2525] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:14.730750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:14.732515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:14.810554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:14.842666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0fb5e-ae73-485d-9412-d9e7bf5c4007 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:14.848735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:14.849490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:14.849771 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:14.850106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] PATH_INFO: `/v3/users/2ce8e4b05ddb44c1865de6ae0827c738` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:14.851637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce8e4b05ddb44c1865de6ae0827c738)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:14.854021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:14.903444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:14.904094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:14.904611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:14.936053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:14.938427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:14.941681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce8e4b05ddb44c1865de6ae0827c738'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:14.958925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce8e4b05ddb44c1865de6ae0827c738'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:14.961829 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce8e4b05ddb44c1865de6ae0827c738'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:14.973481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce8e4b05ddb44c1865de6ae0827c738'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:14.991238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-3a2ff68d-b1aa-4330-aea5-998225f3494d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce8e4b05ddb44c1865de6ae0827c738'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:15.003414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1264/2526] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:14 2022] DELETE /identity/v3/users/2ce8e4b05ddb44c1865de6ae0827c738 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:15.009324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:15.009758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:15.010042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:15.067244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:15.068537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:15.126266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1263/2527] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:39:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:15.146418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:15.148708 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:15.246667 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1265/2528] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:15.256137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:15.259744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:15.328454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096ce96-fc01-4668-9418-a7139c130600 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:15.362994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20f85b-27e8-4fb8-8db2-b0e3655569f9 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:15.370461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:15.372790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:15.373619 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:15.373798 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:15.397352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:15.401084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:15.424309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1266/2529] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:15.457721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:15.471456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:15.473134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:15.473134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:15.473578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:15.629372 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:15.632085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:15.652951 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1264/2530] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:39:15.781028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:15.788088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:15.797433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5b760-2f14-4497-9982-d66ac52c9ea7 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:15.810103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd493b6-a0cd-4d02-90df-6573b6230319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:15.810889 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd493b6-a0cd-4d02-90df-6573b6230319 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:15.811661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd493b6-a0cd-4d02-90df-6573b6230319 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:15.811661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd493b6-a0cd-4d02-90df-6573b6230319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:15.816487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0dd493b6-a0cd-4d02-90df-6573b6230319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:15.843707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd493b6-a0cd-4d02-90df-6573b6230319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:15.847048 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd493b6-a0cd-4d02-90df-6573b6230319 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:15.885475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1267/2531] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:16.243795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:16.245435 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:16.291101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36190e16-57ba-4f8b-a96f-b02b653891e6 service swift] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:16.333213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:16.334428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:16.334812 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:16.335328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] PATH_INFO: `/v3/projects/2e6461ea6bae4fcc898ca3ad15bb74d4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:16.341115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e6461ea6bae4fcc898ca3ad15bb74d4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:16.343944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:16.647689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e6461ea6bae4fcc898ca3ad15bb74d4', 'request_id': 'req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:16.675221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e6461ea6bae4fcc898ca3ad15bb74d4', 'request_id': 'req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:16.706320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e6461ea6bae4fcc898ca3ad15bb74d4', 'request_id': 'req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:16.739334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] The token cache is being invalidate because project 2e6461ea6bae4fcc898ca3ad15bb74d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:16.739680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:16.740715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b0807eb6-b3df-410d-b0e5-7f2d1b5c2ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:16.747824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1265/2532] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:16 2022] DELETE /identity/v3/projects/2e6461ea6bae4fcc898ca3ad15bb74d4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:16.760629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140832-5b75-43f3-a321-9584cfbc7061 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:16.761719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140832-5b75-43f3-a321-9584cfbc7061 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:16.762243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140832-5b75-43f3-a321-9584cfbc7061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:16.859953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6b140832-5b75-43f3-a321-9584cfbc7061 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:16.865083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6b140832-5b75-43f3-a321-9584cfbc7061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:17.233091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1268/2533] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:17.255469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a675-0193-4627-a58a-6e36a47a828c None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:17.255981 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a675-0193-4627-a58a-6e36a47a828c None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:17.256456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a675-0193-4627-a58a-6e36a47a828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:17.370368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-1b33a675-0193-4627-a58a-6e36a47a828c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:17.372444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-1b33a675-0193-4627-a58a-6e36a47a828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:17.405769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1266/2534] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:17.412495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b140832-5b75-43f3-a321-9584cfbc7061 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:17.438194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b140832-5b75-43f3-a321-9584cfbc7061 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:17.455954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:17.456705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:17.457023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:17.457392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:17.458115 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:17.460183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:17.462974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:17.500327 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1269/2535] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:17.506043 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33a675-0193-4627-a58a-6e36a47a828c None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:17.537738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33a675-0193-4627-a58a-6e36a47a828c None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:17.552210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:17.554051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:17.554679 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:17.555653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:17.561836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:17.566400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:17.619226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1267/2536] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:17 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:17.624929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:17.636052 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb320063-337d-4e5d-b8b5-80e21e97e035 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:17.832005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:17.832765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:17.833117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:17.833492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:17.834248 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:17.840570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:17.910623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1270/2537] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:17 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:17.916207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:17.941522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b735f-af04-4a1a-a31e-ba8653fede08 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:17.960113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:17.963676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:17.973573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:17.974291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:17.975582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:17.978896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:18.052459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1268/2538] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:18.057691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:18.084901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7650-8c81-4c33-a609-c26500cab20a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:18.104840 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b33ccc-06e6-43cd-8eeb-94cd8e96b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:18.106465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b33ccc-06e6-43cd-8eeb-94cd8e96b5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:18.108198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b33ccc-06e6-43cd-8eeb-94cd8e96b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:18.108873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b33ccc-06e6-43cd-8eeb-94cd8e96b5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:18.117096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b33ccc-06e6-43cd-8eeb-94cd8e96b5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:18.120343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b33ccc-06e6-43cd-8eeb-94cd8e96b5b4 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:18.155283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1271/2539] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:18.160204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:18.179677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c73214-cf02-4966-bde3-da785f511157 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:18.190066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:18.193678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:18.194075 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:18.194417 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] PATH_INFO: `/v3/projects/b99a53e2cfda4ed0aa225eae423a2bea/users/91db3c87c9594d1baa1404b471ab5963/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:18.263970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99a53e2cfda4ed0aa225eae423a2bea, user_id=91db3c87c9594d1baa1404b471ab5963, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:18.266908 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:18.319802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1269/2540] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:18 2022] PUT /identity/v3/projects/b99a53e2cfda4ed0aa225eae423a2bea/users/91db3c87c9594d1baa1404b471ab5963/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:18.322363 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:18.322755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:18.323189 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:18.376980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:18.378593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:18.546056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:18.563204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1272/2541] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:18.600094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:18.603519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:18.681939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:18.744788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:18.746969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:18.785168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831cb2d-a932-4bab-8513-3c441d13287d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:18.806450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:18.807994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:18.808324 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:18.808587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] PATH_INFO: `/v3/users/9e5ff9a97a0d465e9853882eeab521fe` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:18.813421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5ff9a97a0d465e9853882eeab521fe)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:18.818776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:18.838514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e41e-0bb5-4bbf-ad91-d78a1c81103f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:18.882929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3405-280f-40cf-8b4f-0cb9dfbe5791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:18.884470 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3405-280f-40cf-8b4f-0cb9dfbe5791 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:18.885202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3405-280f-40cf-8b4f-0cb9dfbe5791 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:18.885898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3405-280f-40cf-8b4f-0cb9dfbe5791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:18.923379 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba3405-280f-40cf-8b4f-0cb9dfbe5791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:18.929321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba3405-280f-40cf-8b4f-0cb9dfbe5791 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:18.962340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1270/2542] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:18.982333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5ff9a97a0d465e9853882eeab521fe'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:19.004255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5ff9a97a0d465e9853882eeab521fe'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:19.005524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5ff9a97a0d465e9853882eeab521fe'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:19.030203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5ff9a97a0d465e9853882eeab521fe'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:19.058028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5ff9a97a0d465e9853882eeab521fe'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:19.072944 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1273/2543] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:18 2022] DELETE /identity/v3/users/9e5ff9a97a0d465e9853882eeab521fe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:19.079336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:19.079604 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:19.080204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:19.118564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:19.120130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:19.319827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1271/2544] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:19.331768 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:19.334333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:19.507980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:19.511056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:19.555818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef48e3-c4fa-4d40-9cdf-886e1aa79d3d admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:19.582215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:19.583564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:19.585857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:19.591079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:19.654440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:19.662748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:19.711721 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1274/2545] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:19.835701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29f603-94e4-4727-a378-cfb9efdbb035 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:19.854110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:19.856050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:19.858678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:19.860880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:19.869905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:20.008393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:20.013111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:20.020904 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:20.030262 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1272/2546] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:20.983885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:20.986910 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:21.034790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917cc22-e0cf-4f7b-91c6-8a7b03b37d68 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:21.054659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:21.055498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:21.056150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:21.056150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] PATH_INFO: `/v3/projects/bd54e91fab274042bda3581715952790` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:21.060567 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd54e91fab274042bda3581715952790)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:21.062868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:21.287570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd54e91fab274042bda3581715952790', 'request_id': 'req-b7fd9db6-c6c0-47a5-8a85-845e606452ee'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.326641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd54e91fab274042bda3581715952790', 'request_id': 'req-b7fd9db6-c6c0-47a5-8a85-845e606452ee'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.344452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd54e91fab274042bda3581715952790', 'request_id': 'req-b7fd9db6-c6c0-47a5-8a85-845e606452ee'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.356923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:21.391015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] The token cache is being invalidate because project bd54e91fab274042bda3581715952790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:21.393848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.398157 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b7fd9db6-c6c0-47a5-8a85-845e606452ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.401360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1275/2547] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:20 2022] DELETE /identity/v3/projects/bd54e91fab274042bda3581715952790 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:21.406103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:21.422760 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855edc-054f-4353-9326-a69af48abae4 service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:21.588073 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:21.590354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:21.590912 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:21.595713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] PATH_INFO: `/v3/users/2f0c0d4f723a441bbc28e5ebcc7f8505` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:21.597375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0c0d4f723a441bbc28e5ebcc7f8505)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:21.602074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:21.721658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0c0d4f723a441bbc28e5ebcc7f8505'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.760608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0c0d4f723a441bbc28e5ebcc7f8505'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.783383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0c0d4f723a441bbc28e5ebcc7f8505'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.784577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0c0d4f723a441bbc28e5ebcc7f8505'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.804319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0c0d4f723a441bbc28e5ebcc7f8505'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:21.817508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1273/2548] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:21 2022] DELETE /identity/v3/users/2f0c0d4f723a441bbc28e5ebcc7f8505 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:22.726496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:22.727214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:22.727525 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:22.788075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] MFA Rules not processed for user `91db3c87c9594d1baa1404b471ab5963`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:22.790139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:22.993132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1276/2549] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:23.012169 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:23.014626 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:23.144669 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:23.148951 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:23.305989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b78ad-9563-42ad-891c-a02990954ba7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:23.313411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:23.314158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:23.314364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:23.314645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:23.343034 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:23.344791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:23.366305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1274/2550] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:23.376497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c81a-48c5-4a99-8f18-93309c99b9b8 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:23.382587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:23.383266 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:23.383760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:23.384215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] PATH_INFO: `/v3/projects/dcddf61c6ed84692bb1d3c6eb21960e2` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:23.386244 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcddf61c6ed84692bb1d3c6eb21960e2)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:23.389964 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:23.468821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcddf61c6ed84692bb1d3c6eb21960e2', 'request_id': 'req-0b11e64b-95f3-490c-a1f0-c98e0f375543'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:23.480440 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcddf61c6ed84692bb1d3c6eb21960e2', 'request_id': 'req-0b11e64b-95f3-490c-a1f0-c98e0f375543'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:23.491556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcddf61c6ed84692bb1d3c6eb21960e2', 'request_id': 'req-0b11e64b-95f3-490c-a1f0-c98e0f375543'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:23.534277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] The token cache is being invalidate because project dcddf61c6ed84692bb1d3c6eb21960e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:23.534630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:23.539237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:23.543774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1277/2551] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:23 2022] DELETE /identity/v3/projects/dcddf61c6ed84692bb1d3c6eb21960e2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:23.547743 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:23.584111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c00fad-bb85-41a3-ac4d-217411524328 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:23.674565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:23.909096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:23.910554 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:23.910846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:23.911983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] PATH_INFO: `/v3/users/f1a283ad095247978d9b085dfdba8fa2` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:23.915202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a283ad095247978d9b085dfdba8fa2)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:23.921406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:24.050847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a283ad095247978d9b085dfdba8fa2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:24.129299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a283ad095247978d9b085dfdba8fa2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:24.176264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a283ad095247978d9b085dfdba8fa2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:24.181283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a283ad095247978d9b085dfdba8fa2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:24.209681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7983e197-6b3d-4f58-9aa2-ad1a529b5f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a283ad095247978d9b085dfdba8fa2'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:24.256109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1275/2552] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:23 2022] DELETE /identity/v3/users/f1a283ad095247978d9b085dfdba8fa2 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:25.154015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:25.156050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:25.183229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11e64b-95f3-490c-a1f0-c98e0f375543 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:25.245298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:25.345013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:25.345794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:25.346170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:25.346536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] PATH_INFO: `/v3/projects/3f585b8d353f45e989503ee291b1104a` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:25.349380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f585b8d353f45e989503ee291b1104a)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:25.352496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:25.468857 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f585b8d353f45e989503ee291b1104a', 'request_id': 'req-36a87f80-788b-4540-928c-f090ba2d07b0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:25.489403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f585b8d353f45e989503ee291b1104a', 'request_id': 'req-36a87f80-788b-4540-928c-f090ba2d07b0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:25.505331 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f585b8d353f45e989503ee291b1104a', 'request_id': 'req-36a87f80-788b-4540-928c-f090ba2d07b0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:25.547631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] The token cache is being invalidate because project 3f585b8d353f45e989503ee291b1104a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:25.548152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:25.551413 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-36a87f80-788b-4540-928c-f090ba2d07b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:25.560270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1278/2553] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:25 2022] DELETE /identity/v3/projects/3f585b8d353f45e989503ee291b1104a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:25.562973 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fdb8d-b1bd-4a80-bb6e-45c5be7af3a0 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:25.563882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fdb8d-b1bd-4a80-bb6e-45c5be7af3a0 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:25.563882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fdb8d-b1bd-4a80-bb6e-45c5be7af3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:25.630230 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f61fdb8d-b1bd-4a80-bb6e-45c5be7af3a0 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:25.631702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f61fdb8d-b1bd-4a80-bb6e-45c5be7af3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:25.731601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bcbed-6a7e-4ccb-9cbd-760003faa557 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:25.732092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bcbed-6a7e-4ccb-9cbd-760003faa557 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:25.732582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bcbed-6a7e-4ccb-9cbd-760003faa557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:25.831553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-ed8bcbed-6a7e-4ccb-9cbd-760003faa557 None None] MFA Rules not processed for user `91db3c87c9594d1baa1404b471ab5963`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:25.832919 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ed8bcbed-6a7e-4ccb-9cbd-760003faa557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:25.912349 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1276/2554] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:25.933271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7b84-8743-45bb-8818-c02684f5796a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:25.933580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7b84-8743-45bb-8818-c02684f5796a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:25.933917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7b84-8743-45bb-8818-c02684f5796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:26.001393 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ab7c7b84-8743-45bb-8818-c02684f5796a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:26.002999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ab7c7b84-8743-45bb-8818-c02684f5796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:26.036089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1277/2555] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:26.042957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c7b84-8743-45bb-8818-c02684f5796a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:26.058926 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1279/2556] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:26.086543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c7b84-8743-45bb-8818-c02684f5796a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:26.107526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:26.109687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:26.109976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:26.110258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:26.112499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:26.112809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:26.116636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:26.181179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1278/2557] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:26.183264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bcbed-6a7e-4ccb-9cbd-760003faa557 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:26.253859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bcbed-6a7e-4ccb-9cbd-760003faa557 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:26.268581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:26.269708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:26.270215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:26.270710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:26.276135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:26.285470 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:26.388689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1280/2558] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:26 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:26.389995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:26.416358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3de82c-5ac8-49b7-a1d8-c64344df1f7b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:26.490189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:26.613536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:26.614614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:26.614614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:26.615127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:26.615811 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:26.618174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:26.684995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1279/2559] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:26 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:26.685557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:26.718561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d26da-3e8d-489a-b64b-f996cfd2a141 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:26.732668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:26.737573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:26.738226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:26.738801 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:26.740103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:26.748656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:26.806372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1281/2560] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:26.808899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:26.847324 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326e36-4a26-4c23-8b2b-2ae65ddef229 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:26.872547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:26.874205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:26.875343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:26.876249 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:26.880795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:26.896803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:26.921604 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1280/2561] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:26.931411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:26.958193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea9455-d8f0-4d6b-a102-ca1441e0354a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:26.964093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551f88-f1a8-4a79-989d-dbb06f084e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:26.965317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551f88-f1a8-4a79-989d-dbb06f084e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:26.965789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551f88-f1a8-4a79-989d-dbb06f084e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:26.966393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551f88-f1a8-4a79-989d-dbb06f084e4a admin admin] PATH_INFO: `/v3/projects/11506a8c369a460093338ca2a235b01c/users/fc5aa5e485344a0a9f3841be9b5ec6d7/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:27.087385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:27.087385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:27.192680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:27.224750 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551f88-f1a8-4a79-989d-dbb06f084e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11506a8c369a460093338ca2a235b01c, user_id=fc5aa5e485344a0a9f3841be9b5ec6d7, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:27.267446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551f88-f1a8-4a79-989d-dbb06f084e4a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:27.392974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1282/2562] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:26 2022] PUT /identity/v3/projects/11506a8c369a460093338ca2a235b01c/users/fc5aa5e485344a0a9f3841be9b5ec6d7/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:27.408197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ebcb-921e-4b14-bb1c-2bb31a21a6c0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:27.425998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:27.426386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:27.426998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:27.543214 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] MFA Rules not processed for user `fc5aa5e485344a0a9f3841be9b5ec6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:27.548911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:27.642681 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:27.647304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:27.647914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:27.648365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:27.655814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:27.686146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:27.696878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:27.758066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1281/2563] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:27.784670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1283/2564] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:27.827889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:27.835265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:27.923367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:27.927059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:27.975993 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53454617-b5ff-4cd4-9760-a37a2a86b359 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:27.982532 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1e0e81d0ee04020b43c28347ef3ab6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:27.983266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:27.983552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:27.983949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:28.000756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:28.002735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:28.021226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1282/2565] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:28.210950 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce679fb-94c9-4208-8c41-134325f612da None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:28.222187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:28.223774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:28.224423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:28.225005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] PATH_INFO: `/v3/users/f25041ca39b84b0b9a3b742d0e43e7e0` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:28.228609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25041ca39b84b0b9a3b742d0e43e7e0)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:28.231678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:28.372232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25041ca39b84b0b9a3b742d0e43e7e0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:28.407888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25041ca39b84b0b9a3b742d0e43e7e0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:28.407888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25041ca39b84b0b9a3b742d0e43e7e0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:28.423556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25041ca39b84b0b9a3b742d0e43e7e0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:28.443579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c3adcbdb-0087-45ec-b146-dd0e052a120e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25041ca39b84b0b9a3b742d0e43e7e0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:28.448352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:28.459054 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1284/2566] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:27 2022] DELETE /identity/v3/users/f25041ca39b84b0b9a3b742d0e43e7e0 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:28.948229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:28.959924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:28.978808 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fd717-52e3-423e-87da-bf1c4cf6f1d1 service glance] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:29.164235 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:29.165418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.165954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.166495 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] PATH_INFO: `/v3/projects/1cbcbb427b0d4b47903f586f02e40a64` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.168692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbcbb427b0d4b47903f586f02e40a64)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:29.172408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:29.286404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbcbb427b0d4b47903f586f02e40a64', 'request_id': 'req-5184e0b4-5437-4719-9a29-48c2ed7de262'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:29.296418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbcbb427b0d4b47903f586f02e40a64', 'request_id': 'req-5184e0b4-5437-4719-9a29-48c2ed7de262'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:29.310589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbcbb427b0d4b47903f586f02e40a64', 'request_id': 'req-5184e0b4-5437-4719-9a29-48c2ed7de262'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:29.339998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] The token cache is being invalidate because project 1cbcbb427b0d4b47903f586f02e40a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:29.340472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:29.342522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5184e0b4-5437-4719-9a29-48c2ed7de262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:29.344965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1283/2567] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:28 2022] DELETE /identity/v3/projects/1cbcbb427b0d4b47903f586f02e40a64 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:29.352824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5efe7-00f6-4088-a670-0b6454dfc362 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.353382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5efe7-00f6-4088-a670-0b6454dfc362 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.353504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5efe7-00f6-4088-a670-0b6454dfc362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.388759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-48c5efe7-00f6-4088-a670-0b6454dfc362 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:29.390841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-48c5efe7-00f6-4088-a670-0b6454dfc362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:29.486116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1285/2568] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:29.487691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0984-db09-450f-8b8e-2c96df2356eb None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.487980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0984-db09-450f-8b8e-2c96df2356eb None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.488258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0984-db09-450f-8b8e-2c96df2356eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.517773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a77d0984-db09-450f-8b8e-2c96df2356eb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:29.517773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a77d0984-db09-450f-8b8e-2c96df2356eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:29.533670 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1284/2569] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:29.538613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5efe7-00f6-4088-a670-0b6454dfc362 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:29.556832 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5efe7-00f6-4088-a670-0b6454dfc362 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:29.567194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:29.567702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.568200 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.569101 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.570147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:29.570487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:29.572856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:29.590962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1286/2570] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:29.596729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d0984-db09-450f-8b8e-2c96df2356eb None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:29.611853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d0984-db09-450f-8b8e-2c96df2356eb None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:29.636388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:29.637728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.638258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.639070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.639842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:29.646560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:29.703523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1285/2571] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:29 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:29.712135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:29.730042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624cd9b-7b04-49c6-975c-e31d9b3fd483 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:29.833010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:29.833703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.833985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.834257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.834938 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:29.836933 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:29.872428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1287/2572] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:29 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:29.874150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:29.887789 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1765-8101-431c-a850-2ed1c7ab50fd admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:29.893735 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:29.894394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.894805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.895224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.896050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:29.897843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:29.909894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1286/2573] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:29.916657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:29.945784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde038d-e530-4e0f-8bdc-fc0bb648f9e8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:29.951254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2e7b6-b7e8-44a7-9eb1-09326942165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:29.951997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2e7b6-b7e8-44a7-9eb1-09326942165b admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.952281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2e7b6-b7e8-44a7-9eb1-09326942165b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.952558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2e7b6-b7e8-44a7-9eb1-09326942165b admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:29.953326 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2e7b6-b7e8-44a7-9eb1-09326942165b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:29.954992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2e7b6-b7e8-44a7-9eb1-09326942165b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:29.970091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1288/2574] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:29.975480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:29.989100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a146478-336e-4ee3-a12c-9309b71f70eb admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:29.994288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:29.994986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:29.995295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:29.995568 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] PATH_INFO: `/v3/projects/6217b5140dac430c9e4e0627150fc3dc/users/b7a4bb0f6c5c4614a825f8589311078e/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.019462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6217b5140dac430c9e4e0627150fc3dc, user_id=b7a4bb0f6c5c4614a825f8589311078e, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:30.022310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:30.043938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1287/2575] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:29 2022] PUT /identity/v3/projects/6217b5140dac430c9e4e0627150fc3dc/users/b7a4bb0f6c5c4614a825f8589311078e/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:30.064232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5baa-687d-44f9-8f97-4b230139f6db None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.064603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5baa-687d-44f9-8f97-4b230139f6db None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.065014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5baa-687d-44f9-8f97-4b230139f6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.111516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-cb2f5baa-687d-44f9-8f97-4b230139f6db None None] MFA Rules not processed for user `b7a4bb0f6c5c4614a825f8589311078e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:30.113586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-cb2f5baa-687d-44f9-8f97-4b230139f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:30.241820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:30.261021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1289/2576] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:30.269769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:30.337214 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:30.398136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9899-e9a7-484f-8030-5d8c178d09ad admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:30.407110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:30.408334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.408797 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.410886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.414593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:30.419696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:30.483226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1288/2577] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:30 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:30.487881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5baa-687d-44f9-8f97-4b230139f6db None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:30.506359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5baa-687d-44f9-8f97-4b230139f6db None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:30.593412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:30.594127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.594582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.594863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.595748 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:30.597763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:30.622569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1290/2578] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:30 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:30.628384 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:30.641932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83729-61c0-4af9-8162-defe53fd6569 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:30.648810 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:30.649463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.649748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.650026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.650740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:30.652414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:30.664456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1289/2579] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:30.669394 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:30.682816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5150d74-b57b-41ce-a2ba-f2f6627013e6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:30.689792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:30.690508 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.690791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.691074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] PATH_INFO: `/v3/projects/29e15286168641439e039853f11b8ffd/users/b0a5bcaa15e5495bba5a1c24d4bb7b3e/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.709509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e15286168641439e039853f11b8ffd, user_id=b0a5bcaa15e5495bba5a1c24d4bb7b3e, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:30.712276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:30.744308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1291/2580] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:30 2022] PUT /identity/v3/projects/29e15286168641439e039853f11b8ffd/users/b0a5bcaa15e5495bba5a1c24d4bb7b3e/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:30.749115 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:30.765704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09bba4-a92d-48fb-8d5a-a77cc062e043 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:30.898089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf97ff-c047-43c2-92a6-333c19b9641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:30.898813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf97ff-c047-43c2-92a6-333c19b9641e admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.899105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf97ff-c047-43c2-92a6-333c19b9641e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.899357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf97ff-c047-43c2-92a6-333c19b9641e admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.900140 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf97ff-c047-43c2-92a6-333c19b9641e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:30.905050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf97ff-c047-43c2-92a6-333c19b9641e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:30.917437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1290/2581] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:30.922110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:30.934855 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028435-80c9-4d87-959e-645dfb559174 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:30.941637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:30.942422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.942759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.943072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] PATH_INFO: `/v3/projects/29e15286168641439e039853f11b8ffd/users/b0a5bcaa15e5495bba5a1c24d4bb7b3e/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:30.945369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e15286168641439e039853f11b8ffd, user_id=b0a5bcaa15e5495bba5a1c24d4bb7b3e, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:30.948500 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:30.962381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1292/2582] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:30 2022] PUT /identity/v3/projects/29e15286168641439e039853f11b8ffd/users/b0a5bcaa15e5495bba5a1c24d4bb7b3e/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:30.974493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9addf0-45fa-4847-9b68-353c5fc42ea9 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:30.976082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9addf0-45fa-4847-9b68-353c5fc42ea9 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:30.976082 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9addf0-45fa-4847-9b68-353c5fc42ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:31.007845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cd9addf0-45fa-4847-9b68-353c5fc42ea9 None None] MFA Rules not processed for user `b0a5bcaa15e5495bba5a1c24d4bb7b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:31.009738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cd9addf0-45fa-4847-9b68-353c5fc42ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:31.170252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1291/2583] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:31.192822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:31.196283 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:31.316486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8320-b2fb-47c6-b987-877ec5234d07 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:31.325856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797afd80-4b60-4c6e-8ebf-51bebcc4e030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:31.326970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797afd80-4b60-4c6e-8ebf-51bebcc4e030 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:31.327459 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797afd80-4b60-4c6e-8ebf-51bebcc4e030 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:31.328059 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797afd80-4b60-4c6e-8ebf-51bebcc4e030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:31.345044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797afd80-4b60-4c6e-8ebf-51bebcc4e030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:31.347421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797afd80-4b60-4c6e-8ebf-51bebcc4e030 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:31.365680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1293/2584] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:32.063551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9addf0-45fa-4847-9b68-353c5fc42ea9 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:32.108218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:32.181430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9addf0-45fa-4847-9b68-353c5fc42ea9 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:32.186706 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:32.187475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:32.187847 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:32.188130 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] PATH_INFO: `/v3/users/b7a4bb0f6c5c4614a825f8589311078e` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:32.189784 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a4bb0f6c5c4614a825f8589311078e)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:32.192388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:32.303943 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a4bb0f6c5c4614a825f8589311078e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:32.331498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a4bb0f6c5c4614a825f8589311078e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:32.345448 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a4bb0f6c5c4614a825f8589311078e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:32.346699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a4bb0f6c5c4614a825f8589311078e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:32.356959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a4bb0f6c5c4614a825f8589311078e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:32.370254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1292/2585] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:32 2022] DELETE /identity/v3/users/b7a4bb0f6c5c4614a825f8589311078e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:32.377058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:32.378237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:32.378766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:32.489685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:32.491088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:32.590079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:32.618242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1294/2586] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:32.637264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:32.639421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:32.729029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24ca2-4fb8-4920-96c5-9099b62b5f59 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:32.738483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:32.738483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:32.738483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:32.738483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:32.746825 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:32.749356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:32.767092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1293/2587] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:33.320401 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:33.322642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:33.341329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe14b-8e55-41b7-aa37-929f32556310 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:33.347028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:33.347247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:33.347548 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:33.348023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] PATH_INFO: `/v3/projects/6217b5140dac430c9e4e0627150fc3dc` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:33.350057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6217b5140dac430c9e4e0627150fc3dc)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:33.353367 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:33.428210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6217b5140dac430c9e4e0627150fc3dc', 'request_id': 'req-4302c481-3aa0-4e3c-a844-d9843ad163bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.434928 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6217b5140dac430c9e4e0627150fc3dc', 'request_id': 'req-4302c481-3aa0-4e3c-a844-d9843ad163bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.445172 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6217b5140dac430c9e4e0627150fc3dc', 'request_id': 'req-4302c481-3aa0-4e3c-a844-d9843ad163bb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.457803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] The token cache is being invalidate because project 6217b5140dac430c9e4e0627150fc3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:33.458122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.458769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.460342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1295/2588] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:33 2022] DELETE /identity/v3/projects/6217b5140dac430c9e4e0627150fc3dc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:33.475757 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:33.488728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a697-d05d-4501-a658-6f6316412de1 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:33.564257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:33.596682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:33.597501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:33.597971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:33.598463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] PATH_INFO: `/v3/users/b0a5bcaa15e5495bba5a1c24d4bb7b3e` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:33.599928 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a5bcaa15e5495bba5a1c24d4bb7b3e)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:33.602221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:33.697529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a5bcaa15e5495bba5a1c24d4bb7b3e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.725563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a5bcaa15e5495bba5a1c24d4bb7b3e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.740767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a5bcaa15e5495bba5a1c24d4bb7b3e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.741816 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a5bcaa15e5495bba5a1c24d4bb7b3e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.753382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f839d106-d075-4ca9-a6c1-cee711c0a23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a5bcaa15e5495bba5a1c24d4bb7b3e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:33.762051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1294/2589] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:33 2022] DELETE /identity/v3/users/b0a5bcaa15e5495bba5a1c24d4bb7b3e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:34.242864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:34.245877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:34.277216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c481-3aa0-4e3c-a844-d9843ad163bb admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:34.384351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:34.385433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:34.386130 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:34.386804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] PATH_INFO: `/v3/projects/29e15286168641439e039853f11b8ffd` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:34.388984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e15286168641439e039853f11b8ffd)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:34.392399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:34.452509 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e15286168641439e039853f11b8ffd', 'request_id': 'req-65d2159d-772b-4a7a-801c-c4d9e349d777'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:34.459422 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e15286168641439e039853f11b8ffd', 'request_id': 'req-65d2159d-772b-4a7a-801c-c4d9e349d777'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:34.470915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e15286168641439e039853f11b8ffd', 'request_id': 'req-65d2159d-772b-4a7a-801c-c4d9e349d777'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:34.490506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] The token cache is being invalidate because project 29e15286168641439e039853f11b8ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:34.491094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:34.492084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-65d2159d-772b-4a7a-801c-c4d9e349d777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:34.494152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1296/2590] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:34 2022] DELETE /identity/v3/projects/29e15286168641439e039853f11b8ffd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:34.500631 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af251c-89d3-4477-a38e-7b2f5cc4bcee None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:34.501322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af251c-89d3-4477-a38e-7b2f5cc4bcee None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:34.501742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af251c-89d3-4477-a38e-7b2f5cc4bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:34.539676 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-24af251c-89d3-4477-a38e-7b2f5cc4bcee None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:34.541762 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-24af251c-89d3-4477-a38e-7b2f5cc4bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:34.644352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:34.644645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:34.644925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:34.655777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1295/2591] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:34.655777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b6d9-60c1-4273-bc43-ccd2bce95d61 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:34.655777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b6d9-60c1-4273-bc43-ccd2bce95d61 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:34.655777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b6d9-60c1-4273-bc43-ccd2bce95d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:34.659668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:34.676770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:34.678686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:34.681307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-3f63b6d9-60c1-4273-bc43-ccd2bce95d61 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:34.682604 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3f63b6d9-60c1-4273-bc43-ccd2bce95d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:34.691956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1296/2592] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:34.696927 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b6d9-60c1-4273-bc43-ccd2bce95d61 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:34.707969 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b6d9-60c1-4273-bc43-ccd2bce95d61 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:34.715933 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:34.716695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:34.716977 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:34.717252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:34.717961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:34.718294 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:34.719958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:34.737419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1297/2593] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:39:34.745197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:34.757064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49f38-d23f-40ca-b9a5-caeac5038d5a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:34.763246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:34.764478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:34.765100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:34.765726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:34.766731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:34.768907 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:34.769141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1297/2594] 10.222.0.58 () {58 vars in 967 bytes} [Thu Jul 28 06:39:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:34.789779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:34.791226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:34.821360 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1298/2595] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:34 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:34.826686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:34.860878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:34.914643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a69aa-560e-486a-bcad-cee740bbb926 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:34.948585 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abca3a9-4d97-4d03-b61b-0f4e1f420916 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:34.960775 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:34.961602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:34.961983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:34.962354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:34.963136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:34.966753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:34.998497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:34.999561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.000085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.000518 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.017854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1299/2596] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:34 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:35.022795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.062929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f9b16-7b44-4b82-bf5c-3fdcbfb76c1a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:35.073564 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:35.075444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.076013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.076488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.079383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.083972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.107187 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1300/2597] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:35.111905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.122591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:35.127527 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.130579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.146922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1298/2598] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:39:35.149820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759d5e-1b99-4a54-8814-f26855ea195b admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:35.162388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684a072-3a30-4377-ba5a-28b630bf87fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:35.163531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a072-3a30-4377-ba5a-28b630bf87fb admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.164155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a072-3a30-4377-ba5a-28b630bf87fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.164575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a072-3a30-4377-ba5a-28b630bf87fb admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.165576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684a072-3a30-4377-ba5a-28b630bf87fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.167322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684a072-3a30-4377-ba5a-28b630bf87fb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.193610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1301/2599] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:35.198421 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.213758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0580-362e-45f4-8ce5-2ecbb8fe8494 service swift] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:35.219383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:35.220296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.220406 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.222875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] PATH_INFO: `/v3/projects/9c32c0004c6142b59748c83b94de1209/users/973ec538b9b64740adb376fd55a614a2/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.240687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c32c0004c6142b59748c83b94de1209, user_id=973ec538b9b64740adb376fd55a614a2, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.244171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.269311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1299/2600] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:35 2022] PUT /identity/v3/projects/9c32c0004c6142b59748c83b94de1209/users/973ec538b9b64740adb376fd55a614a2/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:35.283814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61073943-34a7-4829-bdbd-c53a2bf7c5fd None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.283814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61073943-34a7-4829-bdbd-c53a2bf7c5fd None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.283814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61073943-34a7-4829-bdbd-c53a2bf7c5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.336449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-61073943-34a7-4829-bdbd-c53a2bf7c5fd None None] MFA Rules not processed for user `973ec538b9b64740adb376fd55a614a2`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:35.338731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-61073943-34a7-4829-bdbd-c53a2bf7c5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:35.500510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1302/2601] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:35.507487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.643383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873469d-386d-4ae5-b50d-15cc6930578e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:35.652813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:35.653925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.654329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.654636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.655978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.660199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.702398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1300/2602] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:35 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:35.706777 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61073943-34a7-4829-bdbd-c53a2bf7c5fd None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.727737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61073943-34a7-4829-bdbd-c53a2bf7c5fd None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:35.817145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:35.817880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.818139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.818437 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.819111 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.821254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.851040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1303/2603] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:35 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:35.855158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.865896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf976-d277-453b-a7d1-3691428cb09b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:35.870612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:35.871254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.871535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.871849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.872543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.874136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.889890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1301/2604] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:35.894418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.910720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6e24c-f6c4-45e9-990b-31794db86587 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:35.915720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:35.916419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:35.916700 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:35.916974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] PATH_INFO: `/v3/projects/d6cdc0caa7b044eca4f6d304d8982097/users/fd83109097aa49c1922e367b1797cf1f/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:35.928018 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:35.939583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cdc0caa7b044eca4f6d304d8982097, user_id=fd83109097aa49c1922e367b1797cf1f, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:35.943987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:35.965709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1304/2605] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:35 2022] PUT /identity/v3/projects/d6cdc0caa7b044eca4f6d304d8982097/users/fd83109097aa49c1922e367b1797cf1f/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:35.971136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:35.986396 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6b37-6fa5-434b-af48-92897722bcc3 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:36.074342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea21c13-8f4e-437d-bc2e-5e1d8d98274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:36.074995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21c13-8f4e-437d-bc2e-5e1d8d98274c admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:36.075274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21c13-8f4e-437d-bc2e-5e1d8d98274c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:36.075554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21c13-8f4e-437d-bc2e-5e1d8d98274c admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:36.076293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea21c13-8f4e-437d-bc2e-5e1d8d98274c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:36.078006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea21c13-8f4e-437d-bc2e-5e1d8d98274c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:36.088555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1302/2606] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:36.094211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:36.105179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae07d63-26ba-49e7-a0ea-350c5fd63e5f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:36.111403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:36.112118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:36.112394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:36.112682 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] PATH_INFO: `/v3/projects/d6cdc0caa7b044eca4f6d304d8982097/users/fd83109097aa49c1922e367b1797cf1f/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:36.114749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cdc0caa7b044eca4f6d304d8982097, user_id=fd83109097aa49c1922e367b1797cf1f, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:36.117618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:36.130320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1305/2607] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:36 2022] PUT /identity/v3/projects/d6cdc0caa7b044eca4f6d304d8982097/users/fd83109097aa49c1922e367b1797cf1f/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:36.148021 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f623e7-113e-42f5-9eb5-fa08ef87608d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:36.148353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f623e7-113e-42f5-9eb5-fa08ef87608d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:36.148781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f623e7-113e-42f5-9eb5-fa08ef87608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:36.192715 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-04f623e7-113e-42f5-9eb5-fa08ef87608d None None] MFA Rules not processed for user `fd83109097aa49c1922e367b1797cf1f`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:36.194152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-04f623e7-113e-42f5-9eb5-fa08ef87608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:36.231334 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:36.304190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1303/2608] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:36.315211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:36.317019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:36.388929 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827fe0a-9dc0-42e6-815f-7fafc0e0a9d8 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:36.392843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908dd78-04b5-4a42-bb63-4169ff9eb66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:36.393498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908dd78-04b5-4a42-bb63-4169ff9eb66e service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:36.393772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908dd78-04b5-4a42-bb63-4169ff9eb66e service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:36.394045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908dd78-04b5-4a42-bb63-4169ff9eb66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:36.403921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908dd78-04b5-4a42-bb63-4169ff9eb66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:36.405368 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908dd78-04b5-4a42-bb63-4169ff9eb66e service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:36.417689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1306/2609] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:38.317921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f623e7-113e-42f5-9eb5-fa08ef87608d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:38.416466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f623e7-113e-42f5-9eb5-fa08ef87608d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:38.423207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:38.424165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:38.424592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:38.425066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] PATH_INFO: `/v3/users/973ec538b9b64740adb376fd55a614a2` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:38.427427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973ec538b9b64740adb376fd55a614a2)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:38.430053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:38.488237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973ec538b9b64740adb376fd55a614a2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:38.503912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973ec538b9b64740adb376fd55a614a2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:38.504894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973ec538b9b64740adb376fd55a614a2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:38.514608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973ec538b9b64740adb376fd55a614a2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:38.524053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973ec538b9b64740adb376fd55a614a2'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:38.530978 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1304/2610] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:38 2022] DELETE /identity/v3/users/973ec538b9b64740adb376fd55a614a2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:38.536331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:38.537017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:38.537017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:38.559438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:38.560893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:38.642143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1307/2611] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:38.652718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:38.654198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:38.751107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:38.780411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec74271-82d4-4511-b483-b8125aa20b12 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:38.786088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:38.787901 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:38.788613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:38.788990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:38.804349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:38.808280 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:38.829173 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1305/2612] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:39.266572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:39.268157 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:39.280976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96b9ca-0017-4501-8e74-16284d00f8ee None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:39.286820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:39.287770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:39.287924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:39.288240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] PATH_INFO: `/v3/projects/9c32c0004c6142b59748c83b94de1209` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:39.289755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c32c0004c6142b59748c83b94de1209)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:39.291883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:39.357496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c32c0004c6142b59748c83b94de1209', 'request_id': 'req-5964a44a-7942-48e7-b52d-6fb96e16c2b9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.364749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c32c0004c6142b59748c83b94de1209', 'request_id': 'req-5964a44a-7942-48e7-b52d-6fb96e16c2b9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.373529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c32c0004c6142b59748c83b94de1209', 'request_id': 'req-5964a44a-7942-48e7-b52d-6fb96e16c2b9'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.382385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:39.387720 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] The token cache is being invalidate because project 9c32c0004c6142b59748c83b94de1209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:39.388416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.389277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.390948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1308/2613] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:39 2022] DELETE /identity/v3/projects/9c32c0004c6142b59748c83b94de1209 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:39.396146 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:39.407458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796697b5-2f4e-4ce1-8e5b-b2ac4b7902d0 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:39.490174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:39.490883 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:39.491226 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:39.491376 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] PATH_INFO: `/v3/users/fd83109097aa49c1922e367b1797cf1f` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:39.492921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd83109097aa49c1922e367b1797cf1f)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:39.495323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:39.550931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd83109097aa49c1922e367b1797cf1f'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.565097 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd83109097aa49c1922e367b1797cf1f'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.565839 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd83109097aa49c1922e367b1797cf1f'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.574817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd83109097aa49c1922e367b1797cf1f'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.584104 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6406143f-45ab-4b28-b032-86b5ce0cbd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd83109097aa49c1922e367b1797cf1f'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:39.591694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1306/2614] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:39 2022] DELETE /identity/v3/users/fd83109097aa49c1922e367b1797cf1f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:39.940292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:39.941845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:39.965763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a44a-7942-48e7-b52d-6fb96e16c2b9 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:40.084199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:40.085440 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.085851 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.086285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] PATH_INFO: `/v3/projects/d6cdc0caa7b044eca4f6d304d8982097` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.089932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cdc0caa7b044eca4f6d304d8982097)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:40.092587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:40.182971 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cdc0caa7b044eca4f6d304d8982097', 'request_id': 'req-3b37c614-88fa-47cb-baea-530baa39e3b5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:40.197561 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cdc0caa7b044eca4f6d304d8982097', 'request_id': 'req-3b37c614-88fa-47cb-baea-530baa39e3b5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:40.211423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cdc0caa7b044eca4f6d304d8982097', 'request_id': 'req-3b37c614-88fa-47cb-baea-530baa39e3b5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:40.233236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] The token cache is being invalidate because project d6cdc0caa7b044eca4f6d304d8982097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:40.233620 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:40.234291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-3b37c614-88fa-47cb-baea-530baa39e3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:40.236315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1309/2615] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:39 2022] DELETE /identity/v3/projects/d6cdc0caa7b044eca4f6d304d8982097 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:40.241705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24a03-74cc-4ad2-a417-109fba2d617b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.242129 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24a03-74cc-4ad2-a417-109fba2d617b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.242592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24a03-74cc-4ad2-a417-109fba2d617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.281062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-6bd24a03-74cc-4ad2-a417-109fba2d617b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:40.283252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-6bd24a03-74cc-4ad2-a417-109fba2d617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:40.389516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1307/2616] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:40.404067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d05093-c982-4fe0-bf68-64ff5cac3580 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.404571 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d05093-c982-4fe0-bf68-64ff5cac3580 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.405065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d05093-c982-4fe0-bf68-64ff5cac3580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.441069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b2d05093-c982-4fe0-bf68-64ff5cac3580 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:40.442333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b2d05093-c982-4fe0-bf68-64ff5cac3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:40.451947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1310/2617] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:40.456823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24a03-74cc-4ad2-a417-109fba2d617b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:40.468417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24a03-74cc-4ad2-a417-109fba2d617b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:40.475350 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:40.476357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.476682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.477134 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.477873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:40.478279 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:40.480701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:40.482824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:40.504445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1308/2618] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:40.505599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d05093-c982-4fe0-bf68-64ff5cac3580 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:40.521995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d05093-c982-4fe0-bf68-64ff5cac3580 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:40.529365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:40.530450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.530920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.531369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.532577 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:40.536333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:40.584915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1311/2619] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:40 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:40.586144 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:40.600253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098942c-bdf9-4930-9d61-b591952725c2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:40.690585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:40.691312 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.691588 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.691987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.692645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:40.696079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:40.734881 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1309/2620] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:40 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:40.739986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:40.754669 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25939435-ff14-4c64-99bf-e642151000b5 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:40.760882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:40.761820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.762233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.768565 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.770481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:40.777250 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:40.793525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1312/2621] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:40.799220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:40.815841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc1977-689a-4688-a941-8e64016fcdb2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:40.821600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3efcd-f4c3-4918-9962-09845b47c368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:40.822560 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3efcd-f4c3-4918-9962-09845b47c368 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.822902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3efcd-f4c3-4918-9962-09845b47c368 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.823242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3efcd-f4c3-4918-9962-09845b47c368 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.824240 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3efcd-f4c3-4918-9962-09845b47c368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:40.826388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3efcd-f4c3-4918-9962-09845b47c368 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:40.843691 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1310/2622] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:40.847311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:40.864621 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0e21a-ec89-48e7-b4cc-a8c78a4dcf01 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:40.873095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:40.874305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.874792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.875279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] PATH_INFO: `/v3/projects/4e6924fa7dca4ff3911d728ea6ecb873/users/bf3e6e8e80534c26b086bd5d9183b9fb/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.897880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6924fa7dca4ff3911d728ea6ecb873, user_id=bf3e6e8e80534c26b086bd5d9183b9fb, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:40.901728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:40.921539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1313/2623] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:40 2022] PUT /identity/v3/projects/4e6924fa7dca4ff3911d728ea6ecb873/users/bf3e6e8e80534c26b086bd5d9183b9fb/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:40.939668 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12574a49-ca46-4fc1-ad68-370f04b0ae77 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:40.940148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12574a49-ca46-4fc1-ad68-370f04b0ae77 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:40.940630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12574a49-ca46-4fc1-ad68-370f04b0ae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:40.989937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-12574a49-ca46-4fc1-ad68-370f04b0ae77 None None] MFA Rules not processed for user `bf3e6e8e80534c26b086bd5d9183b9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:40.991584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-12574a49-ca46-4fc1-ad68-370f04b0ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:41.095865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1311/2624] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:41.102804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:41.156012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:41.208960 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b1b8-0648-4eb6-94fe-f22f8c38c9bb admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:41.216974 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:41.218660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.218947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.219231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:41.220031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:41.222340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:41.254980 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1314/2625] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:41 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:41.263745 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12574a49-ca46-4fc1-ad68-370f04b0ae77 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:41.282315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12574a49-ca46-4fc1-ad68-370f04b0ae77 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:41.381512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:41.382647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.383267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.383891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:41.385124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:41.388550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:41.402912 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:41.422495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1312/2626] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:41 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:41.427297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:41.442285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733681d-4131-4dd3-9cb0-d93e210be2f0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:41.449277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:41.450253 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.450665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.451042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:41.451953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:41.454864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:41.476100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1315/2627] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:41.482575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:41.495606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b070-89b2-4433-8ea0-84f6b6ab8428 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:41.505398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:41.506224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.506596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.506961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] PATH_INFO: `/v3/projects/61e44fb5472843cc93674c57ef1ae7dc/users/9be1f11230e345089defdae2cdf9fc9b/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:41.525325 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e44fb5472843cc93674c57ef1ae7dc, user_id=9be1f11230e345089defdae2cdf9fc9b, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:41.528084 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:41.546593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1313/2628] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:41 2022] PUT /identity/v3/projects/61e44fb5472843cc93674c57ef1ae7dc/users/9be1f11230e345089defdae2cdf9fc9b/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:41.552760 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:41.567788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d25eb-f9a8-47a7-83f6-ce6b78988b95 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:41.658404 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631f622-8785-4a9f-9dec-27bf4958eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:41.659122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f622-8785-4a9f-9dec-27bf4958eef0 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.659455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f622-8785-4a9f-9dec-27bf4958eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.659873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f622-8785-4a9f-9dec-27bf4958eef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:41.660858 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631f622-8785-4a9f-9dec-27bf4958eef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:41.662843 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631f622-8785-4a9f-9dec-27bf4958eef0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:41.674357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1316/2629] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:41.679269 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:41.690234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2e77-5eeb-41d4-890d-dd0a985ff4b6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:41.696520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:41.697663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.697947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.698352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] PATH_INFO: `/v3/projects/61e44fb5472843cc93674c57ef1ae7dc/users/9be1f11230e345089defdae2cdf9fc9b/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:41.701790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e44fb5472843cc93674c57ef1ae7dc, user_id=9be1f11230e345089defdae2cdf9fc9b, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:41.709959 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:41.729528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1314/2630] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:41 2022] PUT /identity/v3/projects/61e44fb5472843cc93674c57ef1ae7dc/users/9be1f11230e345089defdae2cdf9fc9b/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:41.748024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.748356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.748733 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:41.792014 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] MFA Rules not processed for user `9be1f11230e345089defdae2cdf9fc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:41.793510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:41.891799 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1317/2631] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:41.906549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:41.908599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:41.993233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b86ef-5277-426a-928e-e1754c25d6e5 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:41.997393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571649-a211-40a1-9539-68f457778bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:41.998022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571649-a211-40a1-9539-68f457778bab service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:41.998366 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571649-a211-40a1-9539-68f457778bab service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:41.998581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571649-a211-40a1-9539-68f457778bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:42.015281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86571649-a211-40a1-9539-68f457778bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:42.017955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86571649-a211-40a1-9539-68f457778bab service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:42.029821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1315/2632] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:42.080965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:42.082485 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:42.095749 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f467cd-1aac-4549-adea-1ffbf34b77f7 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:42.099580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265b296-dae7-4108-b42f-5a90f0ad711c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:42.100259 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265b296-dae7-4108-b42f-5a90f0ad711c service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:42.100546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265b296-dae7-4108-b42f-5a90f0ad711c service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:42.100823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265b296-dae7-4108-b42f-5a90f0ad711c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:42.126382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:42.183598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265b296-dae7-4108-b42f-5a90f0ad711c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:42.185507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265b296-dae7-4108-b42f-5a90f0ad711c service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:42.196244 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1318/2633] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:46.292760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571649-a211-40a1-9539-68f457778bab service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:46.402458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571649-a211-40a1-9539-68f457778bab service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:46.408116 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:46.408796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:46.409077 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:46.409361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] PATH_INFO: `/v3/users/bf3e6e8e80534c26b086bd5d9183b9fb` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:46.410639 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3e6e8e80534c26b086bd5d9183b9fb)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:46.412803 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:46.494223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3e6e8e80534c26b086bd5d9183b9fb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:46.511124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:46.518108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3e6e8e80534c26b086bd5d9183b9fb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:46.520132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3e6e8e80534c26b086bd5d9183b9fb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:46.535114 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3e6e8e80534c26b086bd5d9183b9fb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:46.544632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3e6e8e80534c26b086bd5d9183b9fb'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:46.552624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1316/2634] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:46 2022] DELETE /identity/v3/users/bf3e6e8e80534c26b086bd5d9183b9fb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:46.558305 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:46.559175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:46.559175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:46.581457 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:46.582695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:46.652127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1319/2635] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:46.664064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:46.665958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:46.762467 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895780-6896-46f5-bb10-7ea778671102 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:46.770977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:46.779552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:46.780257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:46.780680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:46.795869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:46.798298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:46.819967 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1317/2636] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:47.196734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:47.198821 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:47.224238 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3860-e3de-4091-ae57-cccde8ad95c4 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:47.229744 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:47.230662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:47.231113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:47.231563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] PATH_INFO: `/v3/projects/4e6924fa7dca4ff3911d728ea6ecb873` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:47.233892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6924fa7dca4ff3911d728ea6ecb873)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:47.236359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:47.305666 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6924fa7dca4ff3911d728ea6ecb873', 'request_id': 'req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.317316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6924fa7dca4ff3911d728ea6ecb873', 'request_id': 'req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.330792 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6924fa7dca4ff3911d728ea6ecb873', 'request_id': 'req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.350805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] The token cache is being invalidate because project 4e6924fa7dca4ff3911d728ea6ecb873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:47.351311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.352540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.354898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1320/2637] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:47 2022] DELETE /identity/v3/projects/4e6924fa7dca4ff3911d728ea6ecb873 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:47.360256 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:47.379886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb1b3-7d47-4872-a9c0-7a86281e1931 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:47.467774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:47.468696 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:47.469043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:47.469360 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] PATH_INFO: `/v3/users/9be1f11230e345089defdae2cdf9fc9b` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:47.470778 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be1f11230e345089defdae2cdf9fc9b)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:47.472846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:47.545160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be1f11230e345089defdae2cdf9fc9b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.566075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be1f11230e345089defdae2cdf9fc9b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.566835 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be1f11230e345089defdae2cdf9fc9b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.579030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be1f11230e345089defdae2cdf9fc9b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.594267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f85d695d-fea8-45b1-ade2-d5b82b178a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be1f11230e345089defdae2cdf9fc9b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:47.597181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:47.605274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1318/2638] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:47 2022] DELETE /identity/v3/users/9be1f11230e345089defdae2cdf9fc9b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:48.020863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:48.022796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:48.039651 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bdc7-f7cd-4cc7-b5e9-6afdc8e5e033 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:48.139016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:48.167179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:48.168351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.170317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.170317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] PATH_INFO: `/v3/projects/61e44fb5472843cc93674c57ef1ae7dc` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.171718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e44fb5472843cc93674c57ef1ae7dc)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:48.175385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:48.255654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e44fb5472843cc93674c57ef1ae7dc', 'request_id': 'req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:48.268170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e44fb5472843cc93674c57ef1ae7dc', 'request_id': 'req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:48.283401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e44fb5472843cc93674c57ef1ae7dc', 'request_id': 'req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:48.303860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] The token cache is being invalidate because project 61e44fb5472843cc93674c57ef1ae7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:48.304531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:48.305741 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0d84bd7d-b0dd-4583-ba2a-c494edc1fa33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:48.308424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1321/2639] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:48 2022] DELETE /identity/v3/projects/61e44fb5472843cc93674c57ef1ae7dc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:48.316436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d921d4-fdfd-46b2-a440-eedf63b5df8e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.316961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d921d4-fdfd-46b2-a440-eedf63b5df8e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.317449 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d921d4-fdfd-46b2-a440-eedf63b5df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.350554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d1d921d4-fdfd-46b2-a440-eedf63b5df8e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:48.352555 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d1d921d4-fdfd-46b2-a440-eedf63b5df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:48.457002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1319/2640] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:48.470886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba929c5-5d88-4103-a2ec-5a9476d646f7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.471513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba929c5-5d88-4103-a2ec-5a9476d646f7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.471983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba929c5-5d88-4103-a2ec-5a9476d646f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.504472 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-dba929c5-5d88-4103-a2ec-5a9476d646f7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:48.506583 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-dba929c5-5d88-4103-a2ec-5a9476d646f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:48.521334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1322/2641] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:48.527824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d921d4-fdfd-46b2-a440-eedf63b5df8e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:48.540646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d921d4-fdfd-46b2-a440-eedf63b5df8e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:48.548837 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:48.550291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.550716 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.551504 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.552699 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:48.553175 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:48.555937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:48.576323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1320/2642] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:48.582243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba929c5-5d88-4103-a2ec-5a9476d646f7 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:48.597125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba929c5-5d88-4103-a2ec-5a9476d646f7 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:48.605118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:48.605826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.606228 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.607387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.607986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:48.611314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:48.652446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1323/2643] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:48 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:48.659008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:48.672724 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154ba31-0607-42af-83d9-875c71a2306a admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:48.748853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:48.749506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.749791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.750070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.750753 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:48.752749 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:48.784708 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1321/2644] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:48 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:48.791132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:48.810752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314fbdc-e663-4dfe-a619-89128873ce5e admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:48.819325 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:48.820392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.820827 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.821231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.822345 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:48.825258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:48.843131 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1324/2645] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:48.848433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:48.862124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83246348-9d83-46a6-b64f-88acc30105ad admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:48.869742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e6f20-f499-418d-b684-7ab2cce41b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:48.870585 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6f20-f499-418d-b684-7ab2cce41b74 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.870909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6f20-f499-418d-b684-7ab2cce41b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.871270 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6f20-f499-418d-b684-7ab2cce41b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.872119 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e6f20-f499-418d-b684-7ab2cce41b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:48.873856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e6f20-f499-418d-b684-7ab2cce41b74 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:48.893695 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1322/2646] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:48.898893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:48.911060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4693f-95bb-4407-ac6b-ce6270e19391 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:48.917312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:48.918154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.918536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.918921 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] PATH_INFO: `/v3/projects/1c9541647bad408881d154192446403e/users/3a5d5f3ec57846c6a80f633abf81b06e/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:48.947171 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9541647bad408881d154192446403e, user_id=3a5d5f3ec57846c6a80f633abf81b06e, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:48.950035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:48.969805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1325/2647] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:48 2022] PUT /identity/v3/projects/1c9541647bad408881d154192446403e/users/3a5d5f3ec57846c6a80f633abf81b06e/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:48.982824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f84d4-5a4f-4b4a-9d80-54342311a100 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:48.983264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f84d4-5a4f-4b4a-9d80-54342311a100 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:48.983600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f84d4-5a4f-4b4a-9d80-54342311a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.042900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3f3f84d4-5a4f-4b4a-9d80-54342311a100 None None] MFA Rules not processed for user `3a5d5f3ec57846c6a80f633abf81b06e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:49.045023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3f3f84d4-5a4f-4b4a-9d80-54342311a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:49.144386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:49.160520 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1323/2648] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:49.167040 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:49.250540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f677-9014-4e94-89fb-7fec81171898 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:49.258159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:49.258985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:49.259465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:49.259939 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.261141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:49.263763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:49.281948 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:49.299944 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1326/2649] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:49 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:49.307190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f84d4-5a4f-4b4a-9d80-54342311a100 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:49.326955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f84d4-5a4f-4b4a-9d80-54342311a100 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:49.400476 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:49.401206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:49.401571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:49.401927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.402705 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:49.404894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:49.432687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1324/2650] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:49 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:49.437984 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:49.456067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0423a0-e51c-4740-8d18-89ab5863db04 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:49.463469 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:49.464309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:49.464748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:49.465191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.466151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:49.468612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:49.487866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1327/2651] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:49.493843 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:49.507088 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed6a4e-1053-426f-ba4b-7d3ea4dfdbbb admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:49.513187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:49.513991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:49.514400 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:49.514740 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] PATH_INFO: `/v3/projects/0901f99894ea4735b7ae16e1762c6348/users/84e9a7d01cd348a8aed4fda596e7d00b/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.542435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0901f99894ea4735b7ae16e1762c6348, user_id=84e9a7d01cd348a8aed4fda596e7d00b, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:49.547789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:49.566898 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1325/2652] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:49 2022] PUT /identity/v3/projects/0901f99894ea4735b7ae16e1762c6348/users/84e9a7d01cd348a8aed4fda596e7d00b/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:49.573380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:49.590659 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcfadd-60a4-4cac-894e-077fbad0dfd3 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:49.684055 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35f400-c986-4ebc-9429-fa5f9b468303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:49.684990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f400-c986-4ebc-9429-fa5f9b468303 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:49.685455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f400-c986-4ebc-9429-fa5f9b468303 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:49.685918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f400-c986-4ebc-9429-fa5f9b468303 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.687266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35f400-c986-4ebc-9429-fa5f9b468303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:49.690231 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35f400-c986-4ebc-9429-fa5f9b468303 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:49.709359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1328/2653] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:49.715957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:49.733488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6e03-7ae5-4876-8645-e6ce8c66d5d5 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:49.741916 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:49.743091 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:49.744250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:49.744627 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] PATH_INFO: `/v3/projects/0901f99894ea4735b7ae16e1762c6348/users/84e9a7d01cd348a8aed4fda596e7d00b/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.747255 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0901f99894ea4735b7ae16e1762c6348, user_id=84e9a7d01cd348a8aed4fda596e7d00b, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:49.751737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:49.770405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1326/2654] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:49 2022] PUT /identity/v3/projects/0901f99894ea4735b7ae16e1762c6348/users/84e9a7d01cd348a8aed4fda596e7d00b/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:49.788752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350704c3-ffa0-4806-8029-1549cc553fbc None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:49.789243 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350704c3-ffa0-4806-8029-1549cc553fbc None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:49.789709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350704c3-ffa0-4806-8029-1549cc553fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:49.837702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-350704c3-ffa0-4806-8029-1549cc553fbc None None] MFA Rules not processed for user `84e9a7d01cd348a8aed4fda596e7d00b`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:49.839335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-350704c3-ffa0-4806-8029-1549cc553fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:49.945942 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1329/2655] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:49.966796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:49.970357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:50.056782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d467a-5060-4bdc-a9bf-784f1d772ff5 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:50.061041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:50.062382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:50.062382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:50.062382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:50.074757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:50.077701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:50.097224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1327/2656] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:50.243751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350704c3-ffa0-4806-8029-1549cc553fbc None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:50.259501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350704c3-ffa0-4806-8029-1549cc553fbc None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:50.264408 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5f87c-0a06-4555-bd34-a9047ef4a59c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:50.265317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5f87c-0a06-4555-bd34-a9047ef4a59c service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:50.265758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5f87c-0a06-4555-bd34-a9047ef4a59c service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:50.266091 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5f87c-0a06-4555-bd34-a9047ef4a59c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:50.366101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5f87c-0a06-4555-bd34-a9047ef4a59c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:50.367865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5f87c-0a06-4555-bd34-a9047ef4a59c service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:50.378476 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1330/2657] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:51.378661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:51.380433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:51.470660 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:51.497673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91887d72-b8a7-45d7-9de8-3b6fb88433e4 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:51.506211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:51.507414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:51.507998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:51.508398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] PATH_INFO: `/v3/users/fc5aa5e485344a0a9f3841be9b5ec6d7` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:51.510095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5aa5e485344a0a9f3841be9b5ec6d7)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:51.512352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:51.578969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5aa5e485344a0a9f3841be9b5ec6d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:51.594645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5aa5e485344a0a9f3841be9b5ec6d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:51.595599 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5aa5e485344a0a9f3841be9b5ec6d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:51.605405 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5aa5e485344a0a9f3841be9b5ec6d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:51.614641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5aa5e485344a0a9f3841be9b5ec6d7'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:51.624571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1328/2658] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:51 2022] DELETE /identity/v3/users/fc5aa5e485344a0a9f3841be9b5ec6d7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:51.630570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:51.631263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:51.631478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:51.645937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:51.661415 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:51.662798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:51.742421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1331/2659] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:51.759138 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:51.761635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:51.866780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20580c-2b40-4766-97ec-dc43e7b2b8a2 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:51.871751 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9640a-a4c1-4738-8401-9da8a7c8174c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:51.876043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9640a-a4c1-4738-8401-9da8a7c8174c service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:51.876043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9640a-a4c1-4738-8401-9da8a7c8174c service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:51.876043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9640a-a4c1-4738-8401-9da8a7c8174c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:51.888513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9640a-a4c1-4738-8401-9da8a7c8174c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:51.890794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9640a-a4c1-4738-8401-9da8a7c8174c service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:51.904171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1329/2660] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:52.351037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:52.353473 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:52.376945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab087dce-d717-4992-8ef9-dd82fdfd6108 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:52.384868 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:52.385899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:52.386355 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:52.386788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] PATH_INFO: `/v3/projects/11506a8c369a460093338ca2a235b01c` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:52.388814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11506a8c369a460093338ca2a235b01c)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:52.392403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:52.473505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11506a8c369a460093338ca2a235b01c', 'request_id': 'req-f538173b-d898-4da3-b9e2-fced24e8d7f8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:52.484722 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11506a8c369a460093338ca2a235b01c', 'request_id': 'req-f538173b-d898-4da3-b9e2-fced24e8d7f8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:52.495934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11506a8c369a460093338ca2a235b01c', 'request_id': 'req-f538173b-d898-4da3-b9e2-fced24e8d7f8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:52.516570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] The token cache is being invalidate because project 11506a8c369a460093338ca2a235b01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:52.516995 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:52.517804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-f538173b-d898-4da3-b9e2-fced24e8d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:52.519605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1332/2661] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:52 2022] DELETE /identity/v3/projects/11506a8c369a460093338ca2a235b01c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:52.525264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808c2e-61f4-4a80-8dd0-18f9ce69a631 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:52.526284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808c2e-61f4-4a80-8dd0-18f9ce69a631 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:52.526284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808c2e-61f4-4a80-8dd0-18f9ce69a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:52.548113 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d2808c2e-61f4-4a80-8dd0-18f9ce69a631 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:52.549523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d2808c2e-61f4-4a80-8dd0-18f9ce69a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:52.633281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1330/2662] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:52.641671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3f2d-5930-4c48-ba4f-dd863d7f425d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:52.642515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3f2d-5930-4c48-ba4f-dd863d7f425d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:52.642515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3f2d-5930-4c48-ba4f-dd863d7f425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:52.666782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-401c3f2d-5930-4c48-ba4f-dd863d7f425d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:52.668197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-401c3f2d-5930-4c48-ba4f-dd863d7f425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:52.677662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1333/2663] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:52.682344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2808c2e-61f4-4a80-8dd0-18f9ce69a631 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:52.695913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2808c2e-61f4-4a80-8dd0-18f9ce69a631 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:52.702613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:52.703349 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:52.703718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:52.704045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:52.704863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:52.705224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:52.707069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:52.717252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:52.728579 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1331/2664] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:52.735510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3f2d-5930-4c48-ba4f-dd863d7f425d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:52.747419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3f2d-5930-4c48-ba4f-dd863d7f425d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:52.754501 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:52.755573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:52.756079 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:52.756544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:52.757654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:52.760341 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:52.798280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1334/2665] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:52 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:52.804042 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:52.818514 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa074b7-5dd3-47e3-9eb7-0b49456a502f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:52.928109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:52.929060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:52.929590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:52.930081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:52.931339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:52.935098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:52.975663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1332/2666] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:52 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:39:52.982778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:53.001803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e5ff2-2f9b-4721-a080-874a54b97135 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:53.009640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:53.010697 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.011102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.011592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.012906 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:53.016027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:53.035992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1335/2667] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:53.042044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:53.056530 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4157d6-71ce-4546-9d03-ee8a8d001cec admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:53.062297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084cf2-d60d-4f18-8395-9a146de8f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:53.063136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084cf2-d60d-4f18-8395-9a146de8f067 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.063481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084cf2-d60d-4f18-8395-9a146de8f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.063851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084cf2-d60d-4f18-8395-9a146de8f067 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.064759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084cf2-d60d-4f18-8395-9a146de8f067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:53.066640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084cf2-d60d-4f18-8395-9a146de8f067 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:53.087227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1333/2668] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:53.093541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:53.109077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021d3b-d82e-4b09-9d19-dfd985ff5e28 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:53.118667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:53.119998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.120484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.120970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] PATH_INFO: `/v3/projects/f84bdeffd3e54a71bed97c1568638a45/users/31a2be9bdba74f2d90e0472f377a9b56/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.145546 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84bdeffd3e54a71bed97c1568638a45, user_id=31a2be9bdba74f2d90e0472f377a9b56, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:53.149061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:53.165727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1336/2669] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:53 2022] PUT /identity/v3/projects/f84bdeffd3e54a71bed97c1568638a45/users/31a2be9bdba74f2d90e0472f377a9b56/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:53.181580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.181986 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.182415 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.217846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] MFA Rules not processed for user `31a2be9bdba74f2d90e0472f377a9b56`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:53.219094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:53.321275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1334/2670] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:53.339233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:53.342488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:53.355742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:53.358305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:53.400478 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:53.452902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970384-bc99-4b4f-9be8-7b0607e55682 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:53.458257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32f09d-1dfc-4035-b9ab-a9ac4e7ab3d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:53.458902 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f09d-1dfc-4035-b9ab-a9ac4e7ab3d5 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.459190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f09d-1dfc-4035-b9ab-a9ac4e7ab3d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.459684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f09d-1dfc-4035-b9ab-a9ac4e7ab3d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.472645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32f09d-1dfc-4035-b9ab-a9ac4e7ab3d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:53.475562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32f09d-1dfc-4035-b9ab-a9ac4e7ab3d5 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:53.484232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439309c0-25b3-4066-aa49-e78bcc5da378 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:53.493845 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:53.494896 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1337/2671] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:53.495132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.495460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.496015 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] PATH_INFO: `/v3/users/3a5d5f3ec57846c6a80f633abf81b06e` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.498387 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5d5f3ec57846c6a80f633abf81b06e)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:53.502063 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:53.512824 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:53.570039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5d5f3ec57846c6a80f633abf81b06e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:53.587559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5d5f3ec57846c6a80f633abf81b06e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:53.588998 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5d5f3ec57846c6a80f633abf81b06e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:53.611330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5d5f3ec57846c6a80f633abf81b06e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:53.625887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5d5f3ec57846c6a80f633abf81b06e'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:53.641275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1335/2672] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:53 2022] DELETE /identity/v3/users/3a5d5f3ec57846c6a80f633abf81b06e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:53.643543 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.644320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.644320 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.674199 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:53.677068 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:53.782596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1338/2673] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:53.798008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:53.799743 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:53.911122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ede77-b4c6-4116-b712-843b70534b86 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:53.914808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:53.915461 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:53.915773 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:53.916073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:53.927702 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:53.929221 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:53.946759 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1336/2674] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:54.402820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:54.405077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:54.427481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae9b4-cff7-4175-9b47-f5f98faab317 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:54.435715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:54.436893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:54.437369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:54.437838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] PATH_INFO: `/v3/projects/1c9541647bad408881d154192446403e` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:54.439932 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9541647bad408881d154192446403e)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:54.443660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:54.510486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9541647bad408881d154192446403e', 'request_id': 'req-118ee49c-03ac-4145-bb40-6d770a8a016f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.518486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9541647bad408881d154192446403e', 'request_id': 'req-118ee49c-03ac-4145-bb40-6d770a8a016f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.534863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9541647bad408881d154192446403e', 'request_id': 'req-118ee49c-03ac-4145-bb40-6d770a8a016f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.555484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] The token cache is being invalidate because project 1c9541647bad408881d154192446403e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:54.555957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.556864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.559512 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1339/2675] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:54 2022] DELETE /identity/v3/projects/1c9541647bad408881d154192446403e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:54.565810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:54.578438 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750513c-041f-4743-b9cd-8211895f0667 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:54.671725 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:54.673090 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:54.673896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:54.674403 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] PATH_INFO: `/v3/users/84e9a7d01cd348a8aed4fda596e7d00b` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:54.677154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e9a7d01cd348a8aed4fda596e7d00b)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:54.681087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:54.746968 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:54.774329 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e9a7d01cd348a8aed4fda596e7d00b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.800026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e9a7d01cd348a8aed4fda596e7d00b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.801145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e9a7d01cd348a8aed4fda596e7d00b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.812820 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e9a7d01cd348a8aed4fda596e7d00b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.822304 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-817bb33f-e76e-4156-8b77-3f929b7b9d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e9a7d01cd348a8aed4fda596e7d00b'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:54.830788 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1337/2676] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:54 2022] DELETE /identity/v3/users/84e9a7d01cd348a8aed4fda596e7d00b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:55.223013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:55.225357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:55.254224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee49c-03ac-4145-bb40-6d770a8a016f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:55.350859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:55.374641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:55.375771 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:55.376252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:55.376721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] PATH_INFO: `/v3/projects/0901f99894ea4735b7ae16e1762c6348` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:55.379299 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0901f99894ea4735b7ae16e1762c6348)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:55.393363 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:55.484165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0901f99894ea4735b7ae16e1762c6348', 'request_id': 'req-a15d6d57-48f0-4929-a26c-4630c33b17c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:55.495215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0901f99894ea4735b7ae16e1762c6348', 'request_id': 'req-a15d6d57-48f0-4929-a26c-4630c33b17c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:55.512203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0901f99894ea4735b7ae16e1762c6348', 'request_id': 'req-a15d6d57-48f0-4929-a26c-4630c33b17c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:55.537285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] The token cache is being invalidate because project 0901f99894ea4735b7ae16e1762c6348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:55.537834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:55.539006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a15d6d57-48f0-4929-a26c-4630c33b17c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:55.542050 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1340/2677] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:55 2022] DELETE /identity/v3/projects/0901f99894ea4735b7ae16e1762c6348 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:55.550035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19965900-8e2c-4701-abdf-b10eaaa953e7 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:55.550909 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19965900-8e2c-4701-abdf-b10eaaa953e7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:55.551352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19965900-8e2c-4701-abdf-b10eaaa953e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:55.586737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-19965900-8e2c-4701-abdf-b10eaaa953e7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:55.588936 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-19965900-8e2c-4701-abdf-b10eaaa953e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:55.693988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1338/2678] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:55.715168 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420fc3-f244-4ce4-9f35-e19fd36b286a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:55.715800 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420fc3-f244-4ce4-9f35-e19fd36b286a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:55.716330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420fc3-f244-4ce4-9f35-e19fd36b286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:55.760654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-55420fc3-f244-4ce4-9f35-e19fd36b286a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:55.762027 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-55420fc3-f244-4ce4-9f35-e19fd36b286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:55.772252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1341/2679] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:55.779245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19965900-8e2c-4701-abdf-b10eaaa953e7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:55.796943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19965900-8e2c-4701-abdf-b10eaaa953e7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:55.804775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:55.805592 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:55.806096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:55.806510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:55.808515 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:39:55.809073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:55.814453 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:55.835841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1339/2680] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:39:55.842017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55420fc3-f244-4ce4-9f35-e19fd36b286a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:55.861297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55420fc3-f244-4ce4-9f35-e19fd36b286a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:55.867468 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:55.868258 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:55.868614 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:55.868958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:55.869707 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:55.871758 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:55.919340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1342/2681] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:55 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:55.925878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:55.941471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac615b8-6a92-4702-ab86-c0e1a61ad5d5 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.034954 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.036122 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.036616 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.037099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.038423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.042073 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:56.076679 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1340/2682] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:55 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:56.081248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:56.097449 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612779c5-513f-4715-9c3e-4e7e48e75b02 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.108122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.109190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.109674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.110165 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.111430 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.114505 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:56.134432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1343/2683] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:39:56.139776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:56.158061 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155cfc-60cb-4216-bf12-ac2e367c1779 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.172906 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056401d3-3d40-46e8-8878-8b37b836bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.173765 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056401d3-3d40-46e8-8878-8b37b836bcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.174089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056401d3-3d40-46e8-8878-8b37b836bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.174434 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056401d3-3d40-46e8-8878-8b37b836bcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.175398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056401d3-3d40-46e8-8878-8b37b836bcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.177430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056401d3-3d40-46e8-8878-8b37b836bcd2 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:56.195410 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1341/2684] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:56.201041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:56.221764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f6ef-a9d0-4d10-9872-e4dca57457d8 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.221764 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.222144 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.222239 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.222484 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] PATH_INFO: `/v3/projects/33460645c1644a1892e020a564808b5c/users/d94bf9527d0040dc96e32bc480ff6b67/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.245096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33460645c1644a1892e020a564808b5c, user_id=d94bf9527d0040dc96e32bc480ff6b67, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.249344 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:56.271377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1344/2685] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:56 2022] PUT /identity/v3/projects/33460645c1644a1892e020a564808b5c/users/d94bf9527d0040dc96e32bc480ff6b67/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:56.353890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec5f2f-dc05-4845-a886-2ef1896a4d02 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.354210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec5f2f-dc05-4845-a886-2ef1896a4d02 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.354460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec5f2f-dc05-4845-a886-2ef1896a4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.403689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:56.410417 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-b6ec5f2f-dc05-4845-a886-2ef1896a4d02 None None] MFA Rules not processed for user `d94bf9527d0040dc96e32bc480ff6b67`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:56.413900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-b6ec5f2f-dc05-4845-a886-2ef1896a4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:56.539220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1342/2686] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:56.547336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:56.660905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06521d99-0d67-4ef5-9be0-efec36cd2589 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.666467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.667534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.667941 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.668361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.669270 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.671491 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:56.708510 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1345/2687] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:39:56 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:56.719026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec5f2f-dc05-4845-a886-2ef1896a4d02 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:56.738620 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec5f2f-dc05-4845-a886-2ef1896a4d02 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.816439 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.817262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.817735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.818120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.818890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.821211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:56.857298 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1343/2688] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:39:56 2022] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:39:56.861803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:56.871455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:56.883602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d4755-10b6-4653-ba43-b9f3107e81f7 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.894108 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.895197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.895652 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.896234 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.899337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.905830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:56.921857 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1346/2689] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:56.929179 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:56.948942 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c947ac-5ab7-48e0-8ab3-faefa46e9b0e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:56.957614 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:56.958822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:56.959335 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:56.959891 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] PATH_INFO: `/v3/projects/d8cddc6261064b0ba9af565f85245bc1/users/39d06f382ad3417d9a02e546588bdeb8/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:56.994474 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cddc6261064b0ba9af565f85245bc1, user_id=39d06f382ad3417d9a02e546588bdeb8, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:56.998377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:57.025030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1344/2690] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:56 2022] PUT /identity/v3/projects/d8cddc6261064b0ba9af565f85245bc1/users/39d06f382ad3417d9a02e546588bdeb8/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:57.032633 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:57.055610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e0690-211f-4d3b-9180-5e11dd9b24b3 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:57.153553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc50eb-e7a8-4b06-8796-d13bf82618db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:57.154920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc50eb-e7a8-4b06-8796-d13bf82618db admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:57.155378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc50eb-e7a8-4b06-8796-d13bf82618db admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:57.156026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc50eb-e7a8-4b06-8796-d13bf82618db admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:57.157264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc50eb-e7a8-4b06-8796-d13bf82618db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:57.160627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc50eb-e7a8-4b06-8796-d13bf82618db admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:57.184913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1347/2691] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:39:57.188862 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:57.211268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e041a-ddf7-4fce-af43-0903392a9f42 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:57.220247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:57.222031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:57.222949 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:57.223712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] PATH_INFO: `/v3/projects/d8cddc6261064b0ba9af565f85245bc1/users/39d06f382ad3417d9a02e546588bdeb8/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:57.228607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cddc6261064b0ba9af565f85245bc1, user_id=39d06f382ad3417d9a02e546588bdeb8, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:57.233272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:57.249345 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1345/2692] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:39:57 2022] PUT /identity/v3/projects/d8cddc6261064b0ba9af565f85245bc1/users/39d06f382ad3417d9a02e546588bdeb8/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:57.260804 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8341ff-f527-49ab-b6b6-e994a89f84fe None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:57.261687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8341ff-f527-49ab-b6b6-e994a89f84fe None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:57.261687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8341ff-f527-49ab-b6b6-e994a89f84fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:57.297202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-6b8341ff-f527-49ab-b6b6-e994a89f84fe None None] MFA Rules not processed for user `39d06f382ad3417d9a02e546588bdeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:57.298600 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-6b8341ff-f527-49ab-b6b6-e994a89f84fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:57.418526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1348/2693] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:57.438103 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:57.442927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:57.537727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff8e6-2b56-4c29-8634-fee333eb3878 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:57.542424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447161a-fe17-47fb-b3ef-e1e004920293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:57.542424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447161a-fe17-47fb-b3ef-e1e004920293 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:57.542818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447161a-fe17-47fb-b3ef-e1e004920293 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:57.542960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447161a-fe17-47fb-b3ef-e1e004920293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:57.563549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447161a-fe17-47fb-b3ef-e1e004920293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:57.566479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447161a-fe17-47fb-b3ef-e1e004920293 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:57.574497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:57.587536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1346/2694] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:39:57.785763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8341ff-f527-49ab-b6b6-e994a89f84fe None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:57.870849 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8341ff-f527-49ab-b6b6-e994a89f84fe None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:57.875807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:57.876486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:57.876772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:57.877049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] PATH_INFO: `/v3/users/d94bf9527d0040dc96e32bc480ff6b67` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:57.878266 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94bf9527d0040dc96e32bc480ff6b67)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:57.880361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:57.899265 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:57.946332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94bf9527d0040dc96e32bc480ff6b67'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:57.967086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94bf9527d0040dc96e32bc480ff6b67'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:57.978442 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94bf9527d0040dc96e32bc480ff6b67'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:57.979780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94bf9527d0040dc96e32bc480ff6b67'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:57.989842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94bf9527d0040dc96e32bc480ff6b67'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:57.997371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1349/2695] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:57 2022] DELETE /identity/v3/users/d94bf9527d0040dc96e32bc480ff6b67 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:58.002568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:58.003355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:58.003355 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:58.025757 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:58.027359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:58.115836 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1347/2696] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:39:58.128731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:58.130727 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:58.211742 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9371b7-cc42-4428-800c-5032a55032e5 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:58.215755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:58.216402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:58.216680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:58.217150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:58.228279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:58.229785 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:58.242434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1350/2697] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:39:58.671484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:58.674682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:58.734664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb1bd0-582b-4909-bb85-87071ff7ba67 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:58.744854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:58.745797 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:58.746150 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:58.746487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] PATH_INFO: `/v3/projects/33460645c1644a1892e020a564808b5c` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:58.748148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=33460645c1644a1892e020a564808b5c)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:58.750437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:58.818784 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33460645c1644a1892e020a564808b5c', 'request_id': 'req-a0ac9a75-7120-423e-9f79-b0397e9ea82c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:58.831034 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33460645c1644a1892e020a564808b5c', 'request_id': 'req-a0ac9a75-7120-423e-9f79-b0397e9ea82c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:58.843398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33460645c1644a1892e020a564808b5c', 'request_id': 'req-a0ac9a75-7120-423e-9f79-b0397e9ea82c'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:58.855535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] The token cache is being invalidate because project 33460645c1644a1892e020a564808b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:58.855888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:58.856528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:58.858161 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1348/2698] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:58 2022] DELETE /identity/v3/projects/33460645c1644a1892e020a564808b5c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:58.864654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:58.882407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab591d0d-627e-483d-b700-f7ccad63921a service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:58.978458 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:58.979515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:58.980029 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:58.980499 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] PATH_INFO: `/v3/users/39d06f382ad3417d9a02e546588bdeb8` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:58.982601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d06f382ad3417d9a02e546588bdeb8)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:58.986389 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:59.049989 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:59.062826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d06f382ad3417d9a02e546588bdeb8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.084791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d06f382ad3417d9a02e546588bdeb8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.099595 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d06f382ad3417d9a02e546588bdeb8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.101006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d06f382ad3417d9a02e546588bdeb8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.113025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9a84b80a-71a4-404c-ae26-bf5636cbdd50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d06f382ad3417d9a02e546588bdeb8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.123953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1351/2699] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:39:58 2022] DELETE /identity/v3/users/39d06f382ad3417d9a02e546588bdeb8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:39:59.545414 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:59.547701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:59.580234 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac9a75-7120-423e-9f79-b0397e9ea82c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:39:59.660596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:39:59.661254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:59.661528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:59.661796 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] PATH_INFO: `/v3/projects/d8cddc6261064b0ba9af565f85245bc1` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:59.662984 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cddc6261064b0ba9af565f85245bc1)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:39:59.664923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:39:59.711007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:59.748412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cddc6261064b0ba9af565f85245bc1', 'request_id': 'req-b826cad6-021c-42e1-9e5c-1da283c6e4f5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.756245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cddc6261064b0ba9af565f85245bc1', 'request_id': 'req-b826cad6-021c-42e1-9e5c-1da283c6e4f5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.768800 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cddc6261064b0ba9af565f85245bc1', 'request_id': 'req-b826cad6-021c-42e1-9e5c-1da283c6e4f5'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.796763 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] The token cache is being invalidate because project d8cddc6261064b0ba9af565f85245bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:39:59.797332 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.798423 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-b826cad6-021c-42e1-9e5c-1da283c6e4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:39:59.801894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1349/2700] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:39:59 2022] DELETE /identity/v3/projects/d8cddc6261064b0ba9af565f85245bc1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:39:59.811072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fac95-cc7f-438c-9fb7-035b40779069 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:59.812673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fac95-cc7f-438c-9fb7-035b40779069 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:59.813786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fac95-cc7f-438c-9fb7-035b40779069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:59.841093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cf6fac95-cc7f-438c-9fb7-035b40779069 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:59.842608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cf6fac95-cc7f-438c-9fb7-035b40779069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:59.927101 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1352/2701] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:59.940549 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337226b8-ee11-4e0b-b044-dc8154a8a16c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:39:59.941092 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337226b8-ee11-4e0b-b044-dc8154a8a16c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:39:59.941586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337226b8-ee11-4e0b-b044-dc8154a8a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:39:59.968074 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-337226b8-ee11-4e0b-b044-dc8154a8a16c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:39:59.969287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-337226b8-ee11-4e0b-b044-dc8154a8a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:39:59.979870 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1350/2702] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:39:59.984419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fac95-cc7f-438c-9fb7-035b40779069 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:39:59.998295 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fac95-cc7f-438c-9fb7-035b40779069 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.004074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.004841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.005175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.005454 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.006246 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:40:00.006548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.008180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.022256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1353/2703] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:40:00.027315 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337226b8-ee11-4e0b-b044-dc8154a8a16c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.038727 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337226b8-ee11-4e0b-b044-dc8154a8a16c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.044416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.045141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.045427 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.045701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.046433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.048544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.084081 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1351/2704] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:00 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:40:00.089195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.101402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a01cad-bc73-41e2-a14f-a48d1ad201c4 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.183791 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.184831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.185314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.185832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.187021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.190605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.222678 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1354/2705] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:00 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:40:00.227929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.256537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf62a8a-6dba-420b-936e-5c484c57415d admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.261770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.262522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.262902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.263284 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.264475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.266437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.283466 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1352/2706] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:00.289142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.310486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a2eb-771c-4832-8cb9-637b8b707fef admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.325338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80258-b016-45f8-94d9-f4a895ba5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.326148 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80258-b016-45f8-94d9-f4a895ba5149 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.326486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80258-b016-45f8-94d9-f4a895ba5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.326748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80258-b016-45f8-94d9-f4a895ba5149 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.327573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80258-b016-45f8-94d9-f4a895ba5149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.329313 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80258-b016-45f8-94d9-f4a895ba5149 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.355462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1355/2707] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:00.363931 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.378100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4182d-ee1d-4c13-887c-16c8676b042e admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.383887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.384089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.384540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.384823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] PATH_INFO: `/v3/projects/e27b674412e241d28c49835d9ebbab90/users/d3f9dffcd641468881337030b467208b/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.404723 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27b674412e241d28c49835d9ebbab90, user_id=d3f9dffcd641468881337030b467208b, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.408207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.427685 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1353/2708] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:00 2022] PUT /identity/v3/projects/e27b674412e241d28c49835d9ebbab90/users/d3f9dffcd641468881337030b467208b/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:00.443036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d4b06-fac0-4345-a13e-fba0fd01589f None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.443338 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d4b06-fac0-4345-a13e-fba0fd01589f None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.443613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d4b06-fac0-4345-a13e-fba0fd01589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.479709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ee3d4b06-fac0-4345-a13e-fba0fd01589f None None] MFA Rules not processed for user `d3f9dffcd641468881337030b467208b`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:00.481154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ee3d4b06-fac0-4345-a13e-fba0fd01589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:00.494232 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:00.590898 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1356/2709] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:00.595874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.692372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e58d-7d26-4db9-a1c4-de1607d78519 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.698408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.699049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.699330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.699608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.700309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.702320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.744991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1354/2710] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:00 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:00.750049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d4b06-fac0-4345-a13e-fba0fd01589f None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.768026 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d4b06-fac0-4345-a13e-fba0fd01589f None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.850022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.850661 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.850946 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.851226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.851967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.853952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.881734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1357/2711] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:00 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:40:00.886094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.900416 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e933-9859-46dc-84c9-2fb0a30453fb admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.907268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.908452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.908847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.909313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.910395 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.912738 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.927656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1355/2712] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:00.931842 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:00.944332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8809e27-2eb9-4571-a123-3e3611978107 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:00.950517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:00.951451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:00.951774 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:00.952152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] PATH_INFO: `/v3/projects/9f2d0db184cb4d0ca54474d681325547/users/821d421f353f47b8b3b7efe4cd5014c6/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:00.970092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d0db184cb4d0ca54474d681325547, user_id=821d421f353f47b8b3b7efe4cd5014c6, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:00.973419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:00.994186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1358/2713] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:00 2022] PUT /identity/v3/projects/9f2d0db184cb4d0ca54474d681325547/users/821d421f353f47b8b3b7efe4cd5014c6/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:01.000110 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:01.014067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372899d4-ff07-4f22-9827-8c9676884797 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:01.052878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:01.133688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ebbce-f124-49bd-85e4-b67f996081d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:01.134598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ebbce-f124-49bd-85e4-b67f996081d7 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:01.135290 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ebbce-f124-49bd-85e4-b67f996081d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:01.135674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ebbce-f124-49bd-85e4-b67f996081d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:01.136920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ebbce-f124-49bd-85e4-b67f996081d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:01.139886 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ebbce-f124-49bd-85e4-b67f996081d7 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:01.154043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1356/2714] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:01.158834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:01.170507 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da837de-1b40-4011-8163-26493d1117c0 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:01.176761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:01.177660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:01.178016 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:01.178307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] PATH_INFO: `/v3/projects/9f2d0db184cb4d0ca54474d681325547/users/821d421f353f47b8b3b7efe4cd5014c6/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:01.182306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d0db184cb4d0ca54474d681325547, user_id=821d421f353f47b8b3b7efe4cd5014c6, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:01.186013 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:01.213882 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1359/2715] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:01 2022] PUT /identity/v3/projects/9f2d0db184cb4d0ca54474d681325547/users/821d421f353f47b8b3b7efe4cd5014c6/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:40:01.217261 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:01.217719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:01.218197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:01.255458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] MFA Rules not processed for user `821d421f353f47b8b3b7efe4cd5014c6`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:01.256932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:01.358960 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1357/2716] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:01.377121 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:01.379406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:01.473494 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec533d-e34e-4a2f-ad23-b1d9360f74e8 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:01.488551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633511-7bbc-44fe-8438-aa72fb6389df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:01.488551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633511-7bbc-44fe-8438-aa72fb6389df service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:01.488551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633511-7bbc-44fe-8438-aa72fb6389df service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:01.488551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633511-7bbc-44fe-8438-aa72fb6389df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:01.500343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:01.571146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e633511-7bbc-44fe-8438-aa72fb6389df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:01.573178 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e633511-7bbc-44fe-8438-aa72fb6389df service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:01.584492 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1360/2717] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:05.410971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:05.412783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:05.488883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:05.488883 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:05.489625 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:05.522618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:05.524781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:05.526550 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f8177-73c4-45b5-928b-79730b8e172d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:05.533988 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:05.535007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:05.535482 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:05.535972 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] PATH_INFO: `/v3/users/31a2be9bdba74f2d90e0472f377a9b56` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:05.538051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a2be9bdba74f2d90e0472f377a9b56)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:05.538668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1361/2718] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:05.540674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:05.586611 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:05.588487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:05.611656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:05.614606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a2be9bdba74f2d90e0472f377a9b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:05.635945 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a2be9bdba74f2d90e0472f377a9b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:05.636867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a2be9bdba74f2d90e0472f377a9b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:05.649863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a2be9bdba74f2d90e0472f377a9b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:05.659606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-50a7fbec-d950-419c-ad79-2d1d20aa1e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a2be9bdba74f2d90e0472f377a9b56'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:05.668187 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1358/2719] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:05 2022] DELETE /identity/v3/users/31a2be9bdba74f2d90e0472f377a9b56 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:40:05.673915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:05.674241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:05.674597 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:05.699676 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:05.701086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:05.706451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af8f6c-8fd6-46fe-87d1-839c3b22139d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:05.787603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1359/2720] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:05.805617 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:05.808000 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:05.808854 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:05.809516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:05.809801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:05.810089 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:05.812657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:05.827252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:05.829550 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:05.849677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1362/2721] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:05.913640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c257c-a999-4690-a112-b17855e1b450 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:05.920385 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:05.921231 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:05.921582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:05.922060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:05.936456 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:05.938043 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:05.949806 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1360/2722] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:06.339151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:06.341954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:06.364426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bf90-dda4-4d83-b7f4-d92aa51da4a7 service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:06.378767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:06.379781 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:06.380210 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:06.380665 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] PATH_INFO: `/v3/projects/f84bdeffd3e54a71bed97c1568638a45` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:06.382309 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84bdeffd3e54a71bed97c1568638a45)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:06.385471 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:06.432203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:06.434558 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:06.448122 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:06.478025 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84bdeffd3e54a71bed97c1568638a45', 'request_id': 'req-62f18c09-f9ca-4c26-8c4e-b899626ba35f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:06.487413 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84bdeffd3e54a71bed97c1568638a45', 'request_id': 'req-62f18c09-f9ca-4c26-8c4e-b899626ba35f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:06.501106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84bdeffd3e54a71bed97c1568638a45', 'request_id': 'req-62f18c09-f9ca-4c26-8c4e-b899626ba35f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:06.519159 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] The token cache is being invalidate because project f84bdeffd3e54a71bed97c1568638a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:06.519782 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:06.520734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-62f18c09-f9ca-4c26-8c4e-b899626ba35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:06.523504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1363/2723] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:06 2022] DELETE /identity/v3/projects/f84bdeffd3e54a71bed97c1568638a45 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:06.538581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f849fd7-8e40-415d-beda-c9dc4180cd74 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:06.567540 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:06.628994 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:06.630706 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:06.631194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:06.631724 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:06.635770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:06.721885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:06.723373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:06.739309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1361/2724] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:08.838846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:08.839790 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:08.839968 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:08.872191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:08.874053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:08.962241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1364/2725] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:08.998435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:09.000211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:09.096701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468560c-e1c7-40ea-80f3-d3650ecc6cac service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:09.104286 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af073-e2aa-4223-bd94-04784f3a922f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:09.105106 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af073-e2aa-4223-bd94-04784f3a922f service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:09.105402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af073-e2aa-4223-bd94-04784f3a922f service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:09.105746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af073-e2aa-4223-bd94-04784f3a922f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:09.120458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af073-e2aa-4223-bd94-04784f3a922f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:09.123341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af073-e2aa-4223-bd94-04784f3a922f service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:09.136775 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1362/2726] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:11.981558 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:11.983538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:11.999202 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b4942-ae6b-4723-ba83-60ce41b89a35 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:12.008880 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:12.010057 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:12.010439 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:12.010724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] PATH_INFO: `/v3/users/d3f9dffcd641468881337030b467208b` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:12.011352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:12.012168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:12.012168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:12.012450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f9dffcd641468881337030b467208b)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:12.014074 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:12.035787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:12.037053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:12.046692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1363/2727] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:12.070647 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:12.072479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:12.092884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af625c8-7d70-42d3-9c5b-f4a4811ef42c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:12.099956 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35324a-45e2-47da-af73-384f2cab2c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:12.100914 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35324a-45e2-47da-af73-384f2cab2c07 service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:12.101287 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35324a-45e2-47da-af73-384f2cab2c07 service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:12.101770 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35324a-45e2-47da-af73-384f2cab2c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:12.106292 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f9dffcd641468881337030b467208b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.115687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35324a-45e2-47da-af73-384f2cab2c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:12.118296 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35324a-45e2-47da-af73-384f2cab2c07 service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:12.129936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f9dffcd641468881337030b467208b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.138127 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1364/2728] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:12.143830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f9dffcd641468881337030b467208b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.144919 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f9dffcd641468881337030b467208b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.155894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f9dffcd641468881337030b467208b'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.166110 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1365/2729] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:11 2022] DELETE /identity/v3/users/d3f9dffcd641468881337030b467208b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:12.172381 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:12.172899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:12.173301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:12.202686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:12.203961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:12.257352 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:12.300735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1365/2730] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:12.312486 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:12.314702 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:12.362329 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:12.407748 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558b9c-1dfb-4ed9-97bf-cdc512993453 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:12.413373 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:12.414142 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:12.414582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:12.415063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:12.425878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:12.427332 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:12.438602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1366/2731] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:12.742374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:12.744147 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:12.762636 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576479af-2d38-483f-b86c-e486ed59d3dc None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:12.770878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:12.772595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:12.773191 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:12.773783 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] PATH_INFO: `/v3/projects/e27b674412e241d28c49835d9ebbab90` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:12.775424 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27b674412e241d28c49835d9ebbab90)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:12.778317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:12.834246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27b674412e241d28c49835d9ebbab90', 'request_id': 'req-c9b05b8a-fd39-4998-8849-642e44847a13'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.841249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27b674412e241d28c49835d9ebbab90', 'request_id': 'req-c9b05b8a-fd39-4998-8849-642e44847a13'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.852733 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27b674412e241d28c49835d9ebbab90', 'request_id': 'req-c9b05b8a-fd39-4998-8849-642e44847a13'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.866235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] The token cache is being invalidate because project e27b674412e241d28c49835d9ebbab90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:12.866528 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.867203 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:12.869135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1366/2732] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:12 2022] DELETE /identity/v3/projects/e27b674412e241d28c49835d9ebbab90 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:12.873229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:12.884017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8e81c-39a3-46cb-85a1-4211b413b27a service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:12.947657 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:12.948323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:12.948598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:12.948870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] PATH_INFO: `/v3/users/821d421f353f47b8b3b7efe4cd5014c6` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:12.950136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=821d421f353f47b8b3b7efe4cd5014c6)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:12.952255 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:13.004542 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821d421f353f47b8b3b7efe4cd5014c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.019308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821d421f353f47b8b3b7efe4cd5014c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.028204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821d421f353f47b8b3b7efe4cd5014c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.029143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821d421f353f47b8b3b7efe4cd5014c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.038596 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3e9a8e3-cd85-46bd-a1c6-f174f3bbbabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821d421f353f47b8b3b7efe4cd5014c6'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.046306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1367/2733] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:12 2022] DELETE /identity/v3/users/821d421f353f47b8b3b7efe4cd5014c6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:13.393046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:13.396131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:13.411947 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05b8a-fd39-4998-8849-642e44847a13 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:13.490610 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:13.491276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:13.491559 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:13.491871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] PATH_INFO: `/v3/projects/9f2d0db184cb4d0ca54474d681325547` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:13.493376 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2d0db184cb4d0ca54474d681325547)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:13.495311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:13.546793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2d0db184cb4d0ca54474d681325547', 'request_id': 'req-00845694-b76a-43f4-9538-50dc4f0cdb32'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.553981 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2d0db184cb4d0ca54474d681325547', 'request_id': 'req-00845694-b76a-43f4-9538-50dc4f0cdb32'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.563117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2d0db184cb4d0ca54474d681325547', 'request_id': 'req-00845694-b76a-43f4-9538-50dc4f0cdb32'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.565617 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:13.576656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] The token cache is being invalidate because project 9f2d0db184cb4d0ca54474d681325547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:13.577014 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.577923 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-00845694-b76a-43f4-9538-50dc4f0cdb32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:13.579480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1367/2734] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:13 2022] DELETE /identity/v3/projects/9f2d0db184cb4d0ca54474d681325547 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:40:13.585689 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b37fe-a63c-4686-a305-f1589c444c0d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:13.586007 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b37fe-a63c-4686-a305-f1589c444c0d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:13.586289 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b37fe-a63c-4686-a305-f1589c444c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:13.607479 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-ef7b37fe-a63c-4686-a305-f1589c444c0d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:13.608767 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-ef7b37fe-a63c-4686-a305-f1589c444c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:13.670271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:13.691740 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1368/2735] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:13.704274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0ee3c-1bfe-4063-b1c5-d19ea197bcd7 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:13.704274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0ee3c-1bfe-4063-b1c5-d19ea197bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:13.704274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0ee3c-1bfe-4063-b1c5-d19ea197bcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:13.726033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-87e0ee3c-1bfe-4063-b1c5-d19ea197bcd7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:13.727377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-87e0ee3c-1bfe-4063-b1c5-d19ea197bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:13.742451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1368/2736] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:13.748280 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b37fe-a63c-4686-a305-f1589c444c0d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:13.763867 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b37fe-a63c-4686-a305-f1589c444c0d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:13.768878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:13.769520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:13.769795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:13.770067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:13.770770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:40:13.771283 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:13.773252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:13.791572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1369/2737] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:40:13.792863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0ee3c-1bfe-4063-b1c5-d19ea197bcd7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:13.804241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0ee3c-1bfe-4063-b1c5-d19ea197bcd7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:13.809594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:13.810299 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:13.810591 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:13.812537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:13.812537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:13.814694 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:13.844033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1369/2738] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:13 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:40:13.849380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:13.861397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b18ff0-3c62-4ac1-957a-dc44ac728870 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:13.933240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:13.933890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:13.934170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:13.934444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:13.935205 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:13.937200 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:13.968268 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1370/2739] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:13 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:40:13.972657 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:13.984605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e8f18-58f1-4f5b-beb4-9bb0e74450d6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:13.989903 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:13.990593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:13.990874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:13.991148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:13.991896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:13.993640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:14.006809 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1370/2740] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:14.011778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:14.026860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f056e2c-ad0a-4654-b896-532182fe059a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:14.033949 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af91ec9-3e81-4212-b7c4-53007582096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:14.034599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91ec9-3e81-4212-b7c4-53007582096c admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:14.034878 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91ec9-3e81-4212-b7c4-53007582096c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:14.035180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91ec9-3e81-4212-b7c4-53007582096c admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:14.035938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af91ec9-3e81-4212-b7c4-53007582096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:14.037537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af91ec9-3e81-4212-b7c4-53007582096c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:14.050788 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1371/2741] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:40:14.057072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:14.070941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399c87-deab-480f-8e80-2d2cc6af6181 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:14.076953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:14.077819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:14.078125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:14.078430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] PATH_INFO: `/v3/projects/cd16e2f64ef74a32adc5dd6da4e63348/users/7c8ede96953147d297d4ceb8a3f3f874/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:14.097532 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd16e2f64ef74a32adc5dd6da4e63348, user_id=7c8ede96953147d297d4ceb8a3f3f874, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:14.100237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:14.116746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1371/2742] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:14 2022] PUT /identity/v3/projects/cd16e2f64ef74a32adc5dd6da4e63348/users/7c8ede96953147d297d4ceb8a3f3f874/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:14.129146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba880-32de-4427-8879-38c83934650d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:14.129481 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba880-32de-4427-8879-38c83934650d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:14.129823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba880-32de-4427-8879-38c83934650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:14.161517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b6dba880-32de-4427-8879-38c83934650d None None] MFA Rules not processed for user `7c8ede96953147d297d4ceb8a3f3f874`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:14.162756 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b6dba880-32de-4427-8879-38c83934650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:14.246662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1372/2743] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:14.260128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:14.262022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:14.331786 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa64f39-e3cb-482f-91fa-666d20339212 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:14.337131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:14.338066 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:14.338451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:14.338834 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:14.352309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:14.353819 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:14.365038 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1372/2744] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:15.167488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3acf84-766e-462c-8558-92a56926eabe None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:15.168293 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3acf84-766e-462c-8558-92a56926eabe None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:15.168525 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3acf84-766e-462c-8558-92a56926eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:15.193453 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-7f3acf84-766e-462c-8558-92a56926eabe None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:15.194599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7f3acf84-766e-462c-8558-92a56926eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:15.248823 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:15.274302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1373/2745] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:15.305682 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:15.308308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:15.395330 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786eade-6f96-47e2-b3bb-8a40163b6667 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:15.402044 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c1b12-d79c-4003-9347-b9b2e9661dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:15.402990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1b12-d79c-4003-9347-b9b2e9661dca service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:15.403496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1b12-d79c-4003-9347-b9b2e9661dca service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:15.404002 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1b12-d79c-4003-9347-b9b2e9661dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:15.417022 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c1b12-d79c-4003-9347-b9b2e9661dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:15.420100 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c1b12-d79c-4003-9347-b9b2e9661dca service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:15.432569 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1373/2746] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:17.594519 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3acf84-766e-462c-8558-92a56926eabe None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:17.610134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3acf84-766e-462c-8558-92a56926eabe None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:17.617152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:17.617937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:17.618264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:17.618581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] PATH_INFO: `/v3/users/7c8ede96953147d297d4ceb8a3f3f874` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:17.620215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8ede96953147d297d4ceb8a3f3f874)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:17.622480 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:17.693459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8ede96953147d297d4ceb8a3f3f874'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:17.715685 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8ede96953147d297d4ceb8a3f3f874'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:17.726992 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8ede96953147d297d4ceb8a3f3f874'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:17.728351 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8ede96953147d297d4ceb8a3f3f874'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:17.738256 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8ede96953147d297d4ceb8a3f3f874'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:17.746868 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1374/2747] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:17 2022] DELETE /identity/v3/users/7c8ede96953147d297d4ceb8a3f3f874 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:17.753851 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e794525-ee4c-4aad-964b-a0bf98fee2d6 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:17.754651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e794525-ee4c-4aad-964b-a0bf98fee2d6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:17.754651 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e794525-ee4c-4aad-964b-a0bf98fee2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:17.775915 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-3e794525-ee4c-4aad-964b-a0bf98fee2d6 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:17.777190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-3e794525-ee4c-4aad-964b-a0bf98fee2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:17.789168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:17.868868 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1374/2748] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:17.884218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:17.887064 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:17.967361 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6c200-3429-4406-b5e6-521d3f783c87 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:17.971201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:17.971864 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:17.972150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:17.972428 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:17.982671 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:17.984203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:17.995221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1375/2749] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:18.303340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:18.304120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:18.305361 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:18.339009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:18.341293 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:18.345459 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:18.347663 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:18.355598 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1375/2750] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:18.387939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:18.388732 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7443e6-d1a2-4c7c-b290-be56022b4e32 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:18.390180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:18.394248 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:18.394920 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:18.395334 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:18.395895 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] PATH_INFO: `/v3/projects/cd16e2f64ef74a32adc5dd6da4e63348` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:18.397146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd16e2f64ef74a32adc5dd6da4e63348)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:18.399145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:18.470367 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd16e2f64ef74a32adc5dd6da4e63348', 'request_id': 'req-db433a16-5037-4e1b-bd84-b508392108e0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:18.477586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd16e2f64ef74a32adc5dd6da4e63348', 'request_id': 'req-db433a16-5037-4e1b-bd84-b508392108e0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:18.480739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:18.489497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd16e2f64ef74a32adc5dd6da4e63348', 'request_id': 'req-db433a16-5037-4e1b-bd84-b508392108e0'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:18.493297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7a11-2657-4e2f-a910-c986125ac3c6 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:18.507602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] The token cache is being invalidate because project cd16e2f64ef74a32adc5dd6da4e63348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:18.507945 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:18.508649 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-db433a16-5037-4e1b-bd84-b508392108e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:18.510739 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1376/2751] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:18 2022] DELETE /identity/v3/projects/cd16e2f64ef74a32adc5dd6da4e63348 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:18.585498 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:18.586211 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:18.586485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:18.586758 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:18.590160 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:18.654050 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:18.688747 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:18.690664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:18.704192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1376/2752] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:22.528801 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:22.529587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:22.529587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:22.554990 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:22.556392 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:22.566218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1377/2753] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:22.589501 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:22.591154 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:22.610017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4d95d-717a-4256-8e24-aadcae21a40b service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:22.615795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:22.616838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:22.616985 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:22.617633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:22.628687 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:22.630178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:22.641980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1377/2754] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:29.066605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:29.068869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:29.149962 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3a210-e415-490d-adb3-c82d38c94c1a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:29.157149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:29.157832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:29.158158 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:29.158447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:29.160641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:29.176152 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:29.177728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:29.190523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1378/2755] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:32.635874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=15 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:33.264322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:33.267848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:33.286774 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb077c-e300-40a2-911e-42a693fca83f service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:33.294621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:33.295808 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:33.296276 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:33.296761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] PATH_INFO: `/v3/users/7658a799ca8d4cc7ad03903cd23794b4` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:33.298894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7658a799ca8d4cc7ad03903cd23794b4)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:33.302595 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:33.375262 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7658a799ca8d4cc7ad03903cd23794b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.389202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7658a799ca8d4cc7ad03903cd23794b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.389813 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7658a799ca8d4cc7ad03903cd23794b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.398488 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7658a799ca8d4cc7ad03903cd23794b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.406885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-57f61981-515b-414c-b133-e4838462fcde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7658a799ca8d4cc7ad03903cd23794b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.414642 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1378/2756] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:33 2022] DELETE /identity/v3/users/7658a799ca8d4cc7ad03903cd23794b4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:33.633070 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:33.651391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a705-f767-4920-b444-93e8d97ec28d service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:33.740985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:33.741655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:33.741999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:33.742331 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] PATH_INFO: `/v3/projects/e2226f3ea72e4edbaada18844c837d2f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:33.743964 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2226f3ea72e4edbaada18844c837d2f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:33.746573 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:33.811206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2226f3ea72e4edbaada18844c837d2f', 'request_id': 'req-a6d02173-40c1-4a2b-862a-4c7fbd927399'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.818675 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2226f3ea72e4edbaada18844c837d2f', 'request_id': 'req-a6d02173-40c1-4a2b-862a-4c7fbd927399'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.834107 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2226f3ea72e4edbaada18844c837d2f', 'request_id': 'req-a6d02173-40c1-4a2b-862a-4c7fbd927399'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.847447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] The token cache is being invalidate because project e2226f3ea72e4edbaada18844c837d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:33.847779 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.848451 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-a6d02173-40c1-4a2b-862a-4c7fbd927399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:33.850036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1379/2757] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:33 2022] DELETE /identity/v3/projects/e2226f3ea72e4edbaada18844c837d2f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:33.855817 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d399a-48bb-4ea4-8362-08bbdb8b5b6e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:33.856531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d399a-48bb-4ea4-8362-08bbdb8b5b6e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:33.856729 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d399a-48bb-4ea4-8362-08bbdb8b5b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:33.880145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-421d399a-48bb-4ea4-8362-08bbdb8b5b6e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:33.881281 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-421d399a-48bb-4ea4-8362-08bbdb8b5b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:33.976246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1379/2758] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:33.977736 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc11cf-5d19-4529-8948-462a80a5ef2d None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:33.978098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc11cf-5d19-4529-8948-462a80a5ef2d None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:33.978438 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc11cf-5d19-4529-8948-462a80a5ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.001667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-74bc11cf-5d19-4529-8948-462a80a5ef2d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:34.002889 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-74bc11cf-5d19-4529-8948-462a80a5ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:34.024534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1380/2759] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:34.026382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d399a-48bb-4ea4-8362-08bbdb8b5b6e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:34.047965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d399a-48bb-4ea4-8362-08bbdb8b5b6e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:34.055564 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:34.056949 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.057480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.058141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.060033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:40:34.060612 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:34.063841 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:34.085359 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1380/2760] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:40:34.090037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc11cf-5d19-4529-8948-462a80a5ef2d None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:34.096308 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:34.101092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc11cf-5d19-4529-8948-462a80a5ef2d None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:34.109356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:34.110312 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.110715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.111041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.111915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:34.115817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:34.152163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1381/2761] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:34 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:40:34.158322 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:34.172601 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff15d0-cde7-4f71-8817-bd343977c266 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:34.245594 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:34.246343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.246623 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.246896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.247575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:34.249533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:34.257787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:34.279328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1381/2762] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:34 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:34.284467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:34.296042 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fe49d-0a0f-4e1a-8b0f-3f94387a1ee8 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:34.307382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:34.308063 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.309644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.309925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.310667 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:34.312359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:34.323562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1382/2763] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:40:34.329484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:34.340554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdbaac-e4bf-462e-9485-58333fc2a7c8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:34.347375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ccea4-6a61-4b73-970e-792dc6a6e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:34.348392 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ccea4-6a61-4b73-970e-792dc6a6e9fa admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.348684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ccea4-6a61-4b73-970e-792dc6a6e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.348962 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ccea4-6a61-4b73-970e-792dc6a6e9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.349755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ccea4-6a61-4b73-970e-792dc6a6e9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:34.352602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ccea4-6a61-4b73-970e-792dc6a6e9fa admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:34.367756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1382/2764] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:40:34.374465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:34.396186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119336-91e5-491d-8510-186f3b8459da admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:34.401578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:34.402381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.402718 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.402950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] PATH_INFO: `/v3/projects/95c255a7bcff407fb7480c8fe68b311e/users/785517c878404115a54299c655f3742e/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.426010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c255a7bcff407fb7480c8fe68b311e, user_id=785517c878404115a54299c655f3742e, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:34.432039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:34.459884 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1383/2765] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:34 2022] PUT /identity/v3/projects/95c255a7bcff407fb7480c8fe68b311e/users/785517c878404115a54299c655f3742e/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:34.472661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40c22f-0bae-4990-887e-d5508dc8dbeb None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.473158 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40c22f-0bae-4990-887e-d5508dc8dbeb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.473541 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40c22f-0bae-4990-887e-d5508dc8dbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.518887 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-8f40c22f-0bae-4990-887e-d5508dc8dbeb None None] MFA Rules not processed for user `785517c878404115a54299c655f3742e`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:34.520268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8f40c22f-0bae-4990-887e-d5508dc8dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:34.601604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1383/2766] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:34.614088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:34.616150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:34.685369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b3af-cd65-473f-9db8-617793cbc976 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:34.689548 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:34.690191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:34.690475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:34.690750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:34.700463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:34.701957 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:34.712353 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1384/2767] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:37.678254 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6d5d-f3c5-414a-9ace-ca7eb8647c73 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:37.678864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6d5d-f3c5-414a-9ace-ca7eb8647c73 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:37.678864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6d5d-f3c5-414a-9ace-ca7eb8647c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:37.700246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-507c6d5d-f3c5-414a-9ace-ca7eb8647c73 None None] MFA Rules not processed for user `91db3c87c9594d1baa1404b471ab5963`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:37.701491 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-507c6d5d-f3c5-414a-9ace-ca7eb8647c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:37.770995 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1384/2768] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:44.137536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:44.230207 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fbc08-ef52-4a52-a2a3-cfd020cf9d46 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:44.237728 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:44.238828 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:44.239298 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:44.239793 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] PATH_INFO: `/v3/users/785517c878404115a54299c655f3742e` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:44.241613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785517c878404115a54299c655f3742e)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:44.243986 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:44.465482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785517c878404115a54299c655f3742e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:44.474677 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:44.488581 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785517c878404115a54299c655f3742e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:44.503135 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785517c878404115a54299c655f3742e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:44.504358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785517c878404115a54299c655f3742e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:44.516893 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785517c878404115a54299c655f3742e'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:44.527954 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1385/2769] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:44 2022] DELETE /identity/v3/users/785517c878404115a54299c655f3742e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:40:44.535249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:44.535997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:44.536162 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:44.567864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:44.569969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:44.687955 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1385/2770] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:44.708359 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:44.709863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:44.788335 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a894-8d3b-44d8-bfc2-e3607422d1e5 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:44.794803 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44947a96-595e-4cdc-a599-27b98cb72cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:44.795979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44947a96-595e-4cdc-a599-27b98cb72cad service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:44.796452 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44947a96-595e-4cdc-a599-27b98cb72cad service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:44.796916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44947a96-595e-4cdc-a599-27b98cb72cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:44.814019 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44947a96-595e-4cdc-a599-27b98cb72cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:44.816976 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44947a96-595e-4cdc-a599-27b98cb72cad service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:44.835699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1386/2771] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:45.269196 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:45.271689 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:45.289571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bc221-adc4-45f6-a297-e990fefaacd4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:45.294852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:45.295666 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.295953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.296233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] PATH_INFO: `/v3/projects/95c255a7bcff407fb7480c8fe68b311e` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.297535 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c255a7bcff407fb7480c8fe68b311e)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:45.299890 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:45.320378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:45.380838 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c255a7bcff407fb7480c8fe68b311e', 'request_id': 'req-51b9ffea-1be4-4401-8169-acb6c59e6e25'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:45.387896 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c255a7bcff407fb7480c8fe68b311e', 'request_id': 'req-51b9ffea-1be4-4401-8169-acb6c59e6e25'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:45.397343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c255a7bcff407fb7480c8fe68b311e', 'request_id': 'req-51b9ffea-1be4-4401-8169-acb6c59e6e25'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:45.410263 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] The token cache is being invalidate because project 95c255a7bcff407fb7480c8fe68b311e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:45.410582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:45.411278 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-51b9ffea-1be4-4401-8169-acb6c59e6e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:45.412899 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1386/2772] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:45 2022] DELETE /identity/v3/projects/95c255a7bcff407fb7480c8fe68b311e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:45.419377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c8dc-b241-4f4c-b0ef-22f7f17595c1 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.420003 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c8dc-b241-4f4c-b0ef-22f7f17595c1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.420315 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c8dc-b241-4f4c-b0ef-22f7f17595c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.451695 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-b611c8dc-b241-4f4c-b0ef-22f7f17595c1 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:45.453497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b611c8dc-b241-4f4c-b0ef-22f7f17595c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:45.526826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1387/2773] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:45.535452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb088d-85fc-415d-8cc5-911f892f8dbb None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.536257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb088d-85fc-415d-8cc5-911f892f8dbb None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.536257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb088d-85fc-415d-8cc5-911f892f8dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.561180 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-7cfb088d-85fc-415d-8cc5-911f892f8dbb None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:45.562505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7cfb088d-85fc-415d-8cc5-911f892f8dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:45.575207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1387/2774] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:45.582032 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c8dc-b241-4f4c-b0ef-22f7f17595c1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:45.598236 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c8dc-b241-4f4c-b0ef-22f7f17595c1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:45.605683 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:45.606664 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.607096 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.607526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.608715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:40:45.609188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:45.611970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:45.632940 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1388/2775] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:40:45.639781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb088d-85fc-415d-8cc5-911f892f8dbb None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:45.651093 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb088d-85fc-415d-8cc5-911f892f8dbb None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:45.656670 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:45.657323 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.657603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.657873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.658547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:45.660539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:45.696374 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1388/2776] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:45 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:45.701198 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:45.712387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478a0b5-e90f-46e3-8f97-ffd67ea3a969 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:45.778769 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:45.779587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.780143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.781705 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.784017 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:45.789934 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:45.800654 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:45.829544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1389/2777] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:45 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:45.834045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:45.846086 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3184ddc-93a1-44ef-a2f3-94a51fc93d68 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:45.850939 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:45.851573 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.851885 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.852153 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.852852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:45.854451 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:45.866378 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1389/2778] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:45.870863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:45.882497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa291b3b-8f65-4ab2-97c9-0288b3965e61 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:45.890145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797921-36f4-4d2e-88b8-7b7226dcd8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:45.890796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797921-36f4-4d2e-88b8-7b7226dcd8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.891080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797921-36f4-4d2e-88b8-7b7226dcd8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.891362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797921-36f4-4d2e-88b8-7b7226dcd8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.892190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797921-36f4-4d2e-88b8-7b7226dcd8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:45.893924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797921-36f4-4d2e-88b8-7b7226dcd8d1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:45.906692 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1390/2779] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:45.917206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:45.929344 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a815a-ba31-4456-a4e0-d28a8d0da85b admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:45.934600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:45.935339 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.935656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.935934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] PATH_INFO: `/v3/projects/ad9efb3affe84f669cb606a03a4c1f6d/users/3b98e93cb247404aa432df0cdb435383/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:45.953582 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9efb3affe84f669cb606a03a4c1f6d, user_id=3b98e93cb247404aa432df0cdb435383, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:45.956469 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:45.971958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1390/2780] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:45 2022] PUT /identity/v3/projects/ad9efb3affe84f669cb606a03a4c1f6d/users/3b98e93cb247404aa432df0cdb435383/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:45.982970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae1213-73cc-4cb7-b86d-83ffadfbce46 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:45.983263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae1213-73cc-4cb7-b86d-83ffadfbce46 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:45.983539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae1213-73cc-4cb7-b86d-83ffadfbce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.013886 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-61ae1213-73cc-4cb7-b86d-83ffadfbce46 None None] MFA Rules not processed for user `3b98e93cb247404aa432df0cdb435383`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:46.015343 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-61ae1213-73cc-4cb7-b86d-83ffadfbce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:46.101688 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1391/2781] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:46.106755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:46.188772 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e3a1-e800-431f-8df4-2b8181aed4ce admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:46.192635 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:46.193275 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.193552 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.193821 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.194521 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:46.196452 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:46.227718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1391/2782] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:46 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:40:46.233387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae1213-73cc-4cb7-b86d-83ffadfbce46 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:46.247698 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae1213-73cc-4cb7-b86d-83ffadfbce46 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:46.339786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:46.340426 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.340709 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.340998 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.341655 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:46.343582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:46.374514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1392/2783] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:46 2022] POST /identity/v3/users => generated 303 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:46.379218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:46.392250 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444d09a-f1ca-4c2d-b3b5-0e53feb386f3 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:46.397860 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:46.398534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.398787 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.399208 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.399767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:46.401397 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:46.413441 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1392/2784] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:46.418599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:46.432434 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df587-7483-4b99-96df-1d5f29dcda0a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:46.437712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:46.438432 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.438693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.439085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] PATH_INFO: `/v3/projects/a58d6e11c0da45609ef89d0b45cd786b/users/881869b288e44ad98e11aa93617f27b8/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.460737 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58d6e11c0da45609ef89d0b45cd786b, user_id=881869b288e44ad98e11aa93617f27b8, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:46.465608 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:46.483284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1393/2785] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:46 2022] PUT /identity/v3/projects/a58d6e11c0da45609ef89d0b45cd786b/users/881869b288e44ad98e11aa93617f27b8/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:46.487593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:46.500056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444d3e-bde0-482a-a3d7-376182582528 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:46.504251 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:46.577268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63f67-70c4-416f-a6ae-58115df0128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:46.578465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63f67-70c4-416f-a6ae-58115df0128d admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.578701 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63f67-70c4-416f-a6ae-58115df0128d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.579064 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63f67-70c4-416f-a6ae-58115df0128d admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.580210 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63f67-70c4-416f-a6ae-58115df0128d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:46.582096 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63f67-70c4-416f-a6ae-58115df0128d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:46.597732 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1393/2786] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:46.602555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:46.614103 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c18f4-8004-4a2e-805b-c8b38f416991 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:46.619866 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:46.620278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.620597 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.620871 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] PATH_INFO: `/v3/projects/a58d6e11c0da45609ef89d0b45cd786b/users/881869b288e44ad98e11aa93617f27b8/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.623035 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58d6e11c0da45609ef89d0b45cd786b, user_id=881869b288e44ad98e11aa93617f27b8, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:46.625713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:46.642589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1394/2787] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:46 2022] PUT /identity/v3/projects/a58d6e11c0da45609ef89d0b45cd786b/users/881869b288e44ad98e11aa93617f27b8/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:46.656027 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.656793 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.657602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.701927 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] MFA Rules not processed for user `881869b288e44ad98e11aa93617f27b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:46.703184 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:46.810922 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1394/2788] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:46.821498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:46.823798 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:46.850150 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:46.902999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724c0a-5000-4f24-b2b1-c35225c87f68 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:46.907092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:46.907778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:46.908056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:46.908328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:46.921049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:46.922526 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:46.936290 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1395/2789] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:47.001495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:47.003703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:47.024761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8561c1-e288-4582-8bf8-c7d269014df4 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:47.031351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431348a3-39b4-4918-80c2-5401bbfa01dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:47.032479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431348a3-39b4-4918-80c2-5401bbfa01dc service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:47.032961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431348a3-39b4-4918-80c2-5401bbfa01dc service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:47.033437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431348a3-39b4-4918-80c2-5401bbfa01dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:47.104274 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431348a3-39b4-4918-80c2-5401bbfa01dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:47.105630 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431348a3-39b4-4918-80c2-5401bbfa01dc service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:47.116058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1395/2790] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:50.906640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:51.012500 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a27ed-d1dc-4805-97a4-997e54f97dd7 service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:51.018701 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:51.019514 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:51.020357 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:51.020738 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] PATH_INFO: `/v3/users/3b98e93cb247404aa432df0cdb435383` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:51.022163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b98e93cb247404aa432df0cdb435383)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:51.024506 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:51.092257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b98e93cb247404aa432df0cdb435383'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.109141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b98e93cb247404aa432df0cdb435383'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.117069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b98e93cb247404aa432df0cdb435383'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.117860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b98e93cb247404aa432df0cdb435383'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.128464 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b98e93cb247404aa432df0cdb435383'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.139356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1396/2791] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:50 2022] DELETE /identity/v3/users/3b98e93cb247404aa432df0cdb435383 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:51.145805 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8f271-2ec7-42f7-a721-a9c74d3ae949 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:51.146480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8f271-2ec7-42f7-a721-a9c74d3ae949 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:51.146624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8f271-2ec7-42f7-a721-a9c74d3ae949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:51.177007 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-abc8f271-2ec7-42f7-a721-a9c74d3ae949 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:51.179067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-abc8f271-2ec7-42f7-a721-a9c74d3ae949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:51.224762 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:51.276328 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1396/2792] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:51.289607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:51.291416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:51.365053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:51.383153 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9134a-dced-4540-942b-e1b74062b592 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:51.387547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:51.388221 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:51.388498 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:51.388768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:51.406278 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:51.407832 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:51.420105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1397/2793] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:51.697455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:51.697746 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:51.698030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:51.719659 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:51.721197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:51.732089 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1397/2794] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:51.759044 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:51.760845 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:51.820684 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:51.823499 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:51.844894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca31dc-20e2-48c3-8ab4-3215a8816c0e None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:51.853369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:51.854497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:51.854971 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:51.855380 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] PATH_INFO: `/v3/projects/ad9efb3affe84f669cb606a03a4c1f6d` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:51.857563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9efb3affe84f669cb606a03a4c1f6d)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:51.860643 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:51.895983 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9314d-dd7e-405a-bf3e-3a47c89fffa4 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:51.904206 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:51.905011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:51.905381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:51.905839 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:51.917721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:51.920094 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:51.932371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1398/2795] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:40:51.935524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9efb3affe84f669cb606a03a4c1f6d', 'request_id': 'req-7bfaf9e3-650a-4944-bc56-af3987c85ff0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.943025 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9efb3affe84f669cb606a03a4c1f6d', 'request_id': 'req-7bfaf9e3-650a-4944-bc56-af3987c85ff0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.952761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9efb3affe84f669cb606a03a4c1f6d', 'request_id': 'req-7bfaf9e3-650a-4944-bc56-af3987c85ff0'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.968039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] The token cache is being invalidate because project ad9efb3affe84f669cb606a03a4c1f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:51.968483 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.969507 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:51.971170 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1398/2796] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:51 2022] DELETE /identity/v3/projects/ad9efb3affe84f669cb606a03a4c1f6d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:51.975787 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:51.988139 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71af8-40e9-47ff-ac2d-58822c01e37f service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:52.067521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:52.068141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:52.068427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:52.068714 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] PATH_INFO: `/v3/users/881869b288e44ad98e11aa93617f27b8` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:52.070012 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=881869b288e44ad98e11aa93617f27b8)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:52.072011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:52.139054 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881869b288e44ad98e11aa93617f27b8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.152660 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881869b288e44ad98e11aa93617f27b8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.162077 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:52.164721 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881869b288e44ad98e11aa93617f27b8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.165610 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881869b288e44ad98e11aa93617f27b8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.176151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8018c574-f0c7-4abc-8718-b6e614cb4b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881869b288e44ad98e11aa93617f27b8'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.183549 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1399/2797] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:40:51 2022] DELETE /identity/v3/users/881869b288e44ad98e11aa93617f27b8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:52.563199 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:52.565472 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:52.589247 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaf9e3-650a-4944-bc56-af3987c85ff0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:52.683603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:52.684316 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:52.684596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:52.684869 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] PATH_INFO: `/v3/projects/a58d6e11c0da45609ef89d0b45cd786b` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:52.686132 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58d6e11c0da45609ef89d0b45cd786b)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:52.688168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:52.740245 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:52.744058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58d6e11c0da45609ef89d0b45cd786b', 'request_id': 'req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.753264 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58d6e11c0da45609ef89d0b45cd786b', 'request_id': 'req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.762556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58d6e11c0da45609ef89d0b45cd786b', 'request_id': 'req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.775534 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] The token cache is being invalidate because project a58d6e11c0da45609ef89d0b45cd786b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:40:52.775913 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.776661 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-6cf2f86c-78fb-40ed-aed4-a6630906a2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:40:52.778338 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1399/2798] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:40:52 2022] DELETE /identity/v3/projects/a58d6e11c0da45609ef89d0b45cd786b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:52.785922 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e235e54-ff1c-4005-9796-f18feed1c840 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:52.786421 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e235e54-ff1c-4005-9796-f18feed1c840 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:52.786947 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e235e54-ff1c-4005-9796-f18feed1c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:52.822395 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-3e235e54-ff1c-4005-9796-f18feed1c840 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:52.824161 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-3e235e54-ff1c-4005-9796-f18feed1c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:52.896257 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1400/2799] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:52.905505 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b79a99-0cd1-4b8e-aa3a-5760533e6d2d None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:52.905827 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b79a99-0cd1-4b8e-aa3a-5760533e6d2d None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:52.906072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b79a99-0cd1-4b8e-aa3a-5760533e6d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:52.930040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-03b79a99-0cd1-4b8e-aa3a-5760533e6d2d None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:52.931249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-03b79a99-0cd1-4b8e-aa3a-5760533e6d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:52.939937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1400/2800] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:40:52.944475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e235e54-ff1c-4005-9796-f18feed1c840 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:52.955155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e235e54-ff1c-4005-9796-f18feed1c840 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:52.960724 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:52.961593 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:52.962009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:52.962385 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:52.963090 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:40:52.963388 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:52.965180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:52.985245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1401/2801] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:40:52.992742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b79a99-0cd1-4b8e-aa3a-5760533e6d2d None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.008253 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b79a99-0cd1-4b8e-aa3a-5760533e6d2d None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.016188 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.017079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.017563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.017905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.018975 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.022409 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.059854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1401/2802] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:52 2022] POST /identity/v3/projects => generated 407 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:53.064648 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.075531 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae308c-8ea8-47a3-a166-33b1a234875d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.176553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.177197 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.177538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.177879 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.178620 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.181497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.216381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1402/2803] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:53 2022] POST /identity/v3/users => generated 304 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:53.223047 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.236013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dea375-c19f-4d2f-b995-cff2fdbf56a6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.243769 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.244737 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.245216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.245649 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.247016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.249863 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.263823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1402/2804] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:40:53.268067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.279598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f7c0e-c1a3-453a-b439-a83dd5f76268 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.286636 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99cc91-54c4-4b4b-b452-af08d00c8d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.287411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99cc91-54c4-4b4b-b452-af08d00c8d61 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.287696 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99cc91-54c4-4b4b-b452-af08d00c8d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.287979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99cc91-54c4-4b4b-b452-af08d00c8d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.288770 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99cc91-54c4-4b4b-b452-af08d00c8d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.290794 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99cc91-54c4-4b4b-b452-af08d00c8d61 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.304185 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1403/2805] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:53.309183 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.326997 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d1345-f6b0-4e38-b12d-77f6bb239ef9 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.350683 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.351908 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.352377 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.352850 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] PATH_INFO: `/v3/projects/3906d484179f4eb8a1cdc5d5de7b4e67/users/75efb19a33f2403c84340c7b1cd20317/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.384202 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3906d484179f4eb8a1cdc5d5de7b4e67, user_id=75efb19a33f2403c84340c7b1cd20317, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.389333 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.421040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1403/2806] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:53 2022] PUT /identity/v3/projects/3906d484179f4eb8a1cdc5d5de7b4e67/users/75efb19a33f2403c84340c7b1cd20317/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:53.434900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107276b-9557-4f76-802c-bed186a3cda3 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.435302 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107276b-9557-4f76-802c-bed186a3cda3 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.435826 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107276b-9557-4f76-802c-bed186a3cda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.483961 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-8107276b-9557-4f76-802c-bed186a3cda3 None None] MFA Rules not processed for user `75efb19a33f2403c84340c7b1cd20317`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:53.485203 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8107276b-9557-4f76-802c-bed186a3cda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:53.522420 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:53.580323 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1404/2807] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:53.586009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.742068 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d22dbc-beb3-458f-b904-413dd939c803 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.747368 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.748108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.748428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.748739 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.749561 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.751556 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.788148 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1404/2808] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:40:53 2022] POST /identity/v3/projects => generated 409 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:53.793414 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107276b-9557-4f76-802c-bed186a3cda3 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.811176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107276b-9557-4f76-802c-bed186a3cda3 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.903475 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.904570 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.905056 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.905918 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.907164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.910780 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.946383 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1405/2809] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:40:53 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:40:53.951479 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:53.959961 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:53.969243 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe9008-c7d7-45ee-a4bd-210c010164a0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:53.978108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:53.979070 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:53.979496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:53.979977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:53.981095 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:53.982719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:53.994710 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1405/2810] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:53.999201 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:54.010154 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a264777-3ff2-4f44-9e95-a54c8a792228 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:54.016515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:54.017281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:54.017836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:54.018301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] PATH_INFO: `/v3/projects/9ad7fb27c6f24439b355a5b409aa1c2a/users/e741be9ad615437d965ba3522266b8ff/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:54.039587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad7fb27c6f24439b355a5b409aa1c2a, user_id=e741be9ad615437d965ba3522266b8ff, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:54.042382 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:54.058684 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1406/2811] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:53 2022] PUT /identity/v3/projects/9ad7fb27c6f24439b355a5b409aa1c2a/users/e741be9ad615437d965ba3522266b8ff/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:40:54.063083 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:54.084460 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb73717-f6b0-40df-96fd-7e449342defd admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:54.155481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63827b-ac7d-4207-983e-08b13ab0e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:54.156156 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63827b-ac7d-4207-983e-08b13ab0e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:54.156436 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63827b-ac7d-4207-983e-08b13ab0e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:54.156711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63827b-ac7d-4207-983e-08b13ab0e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:54.157411 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63827b-ac7d-4207-983e-08b13ab0e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:54.159036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63827b-ac7d-4207-983e-08b13ab0e1ce admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:54.170135 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1406/2812] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:40:54.175009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:54.187163 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edcaf0-f2bb-47c4-9fae-7f08df78744c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:54.195149 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:54.196267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:54.196267 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:54.197418 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] PATH_INFO: `/v3/projects/9ad7fb27c6f24439b355a5b409aa1c2a/users/e741be9ad615437d965ba3522266b8ff/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:54.200517 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad7fb27c6f24439b355a5b409aa1c2a, user_id=e741be9ad615437d965ba3522266b8ff, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:54.203397 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:54.220307 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1407/2813] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:40:54 2022] PUT /identity/v3/projects/9ad7fb27c6f24439b355a5b409aa1c2a/users/e741be9ad615437d965ba3522266b8ff/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:40:54.236584 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:54.237085 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:54.237604 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:54.283982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] MFA Rules not processed for user `e741be9ad615437d965ba3522266b8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:54.285117 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:54.366953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1407/2814] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:40:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:54.383186 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:54.385924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:54.513612 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b398-b1d4-406e-9c56-e190683e9eea admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:54.520370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2d5de-8997-46e4-8950-813c91804acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:54.521465 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d5de-8997-46e4-8950-813c91804acb service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:54.521956 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d5de-8997-46e4-8950-813c91804acb service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:54.522409 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d5de-8997-46e4-8950-813c91804acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:54.539092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2d5de-8997-46e4-8950-813c91804acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:54.541401 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2d5de-8997-46e4-8950-813c91804acb service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:54.555105 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1408/2815] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:54.763373 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:54.765223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:54.781475 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22876-95ac-4ab0-ab97-edbbcdbd41ec None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:54.788755 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:54.789844 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:54.790353 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:54.790957 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:54.890145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:54.891946 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:54.906818 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1408/2816] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:55.083446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1dbe-554d-47d2-8367-022560a6c005 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:55.084291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1dbe-554d-47d2-8367-022560a6c005 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:55.084483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1dbe-554d-47d2-8367-022560a6c005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:55.094820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:55.199321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-f35c1dbe-554d-47d2-8367-022560a6c005 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:55.201365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f35c1dbe-554d-47d2-8367-022560a6c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:55.292530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1409/2817] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:55.320940 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:55.323268 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:55.345782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:55.514067 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335caf9-fad7-4474-a6e6-306e0fd60850 service cinder] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:55.526039 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:55.528596 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:55.528712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:55.529249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:55.541412 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:55.543426 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:55.555301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1409/2818] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:40:58.192772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdf9e-7039-45c1-ab36-e551f3995fe8 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:58.192772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdf9e-7039-45c1-ab36-e551f3995fe8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:58.192772 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdf9e-7039-45c1-ab36-e551f3995fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:58.228877 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-5d8cdf9e-7039-45c1-ab36-e551f3995fe8 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:40:58.230978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5d8cdf9e-7039-45c1-ab36-e551f3995fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:58.241455 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1410/2819] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:40:58.263864 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:40:58.265485 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:40:58.282510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bbb15-0e0d-4069-9107-f03726f8d10a service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:40:58.288678 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:40:58.289600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:40:58.290023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:40:58.290437 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:40:58.306357 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:40:58.308049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:40:58.319386 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1410/2820] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:00.822547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdf9e-7039-45c1-ab36-e551f3995fe8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:00.860378 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdf9e-7039-45c1-ab36-e551f3995fe8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:00.870204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30837664-95e3-4537-9668-92953eeafdff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:00.870937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837664-95e3-4537-9668-92953eeafdff service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:00.871496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837664-95e3-4537-9668-92953eeafdff service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:00.871819 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837664-95e3-4537-9668-92953eeafdff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:00.874589 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-30837664-95e3-4537-9668-92953eeafdff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:00.894523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30837664-95e3-4537-9668-92953eeafdff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:00.900166 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30837664-95e3-4537-9668-92953eeafdff service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:00.930081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1411/2821] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:00.983058 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:00.996810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb6158-0bb5-4b6f-ae08-edb65b0ddc2f service nova] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:01.013005 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:01.013878 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:01.014317 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:01.014858 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] PATH_INFO: `/v3/users/75efb19a33f2403c84340c7b1cd20317` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:01.016365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=75efb19a33f2403c84340c7b1cd20317)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:01.019246 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:01.115297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75efb19a33f2403c84340c7b1cd20317'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:01.147522 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75efb19a33f2403c84340c7b1cd20317'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:01.149001 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75efb19a33f2403c84340c7b1cd20317'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:01.165235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75efb19a33f2403c84340c7b1cd20317'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:01.179232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75efb19a33f2403c84340c7b1cd20317'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:01.200206 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1411/2822] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:00 2022] DELETE /identity/v3/users/75efb19a33f2403c84340c7b1cd20317 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:01.203834 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831003-aa20-4a87-b4a8-5f09602e3cf7 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:01.204609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831003-aa20-4a87-b4a8-5f09602e3cf7 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:01.205381 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831003-aa20-4a87-b4a8-5f09602e3cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:01.247569 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-95831003-aa20-4a87-b4a8-5f09602e3cf7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:01.251060 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-95831003-aa20-4a87-b4a8-5f09602e3cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:01.387196 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1412/2823] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:01.401575 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:01.404884 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:01.461632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:01.476672 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:01.477155 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:01.477627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:01.500590 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac6d3-773f-442b-a161-d9a1c6640ffd admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:01.504992 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:01.505648 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:01.505934 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:01.506207 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:01.513093 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:01.515181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:01.521051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:01.523343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:01.529528 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1413/2824] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:01.545675 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1412/2825] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:01.556220 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:01.558496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:01.633407 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=100 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:01.684622 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911818-f938-42a2-af2a-320d8b50eb4e None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:01.696088 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:01.696786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:01.697215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:01.697567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:01.709913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:01.712113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:01.728460 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1414/2826] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:01.964046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:01.965876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:01.988873 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160516b4-46e0-481d-8369-17c128751255 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:02.000194 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:02.002831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:02.003795 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:02.004537 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] PATH_INFO: `/v3/projects/3906d484179f4eb8a1cdc5d5de7b4e67` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:02.007399 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3906d484179f4eb8a1cdc5d5de7b4e67)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:02.011288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:02.089192 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3906d484179f4eb8a1cdc5d5de7b4e67', 'request_id': 'req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.099650 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3906d484179f4eb8a1cdc5d5de7b4e67', 'request_id': 'req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.109536 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3906d484179f4eb8a1cdc5d5de7b4e67', 'request_id': 'req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.129295 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] The token cache is being invalidate because project 3906d484179f4eb8a1cdc5d5de7b4e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:02.129736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.130645 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.133181 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1413/2827] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:01 2022] DELETE /identity/v3/projects/3906d484179f4eb8a1cdc5d5de7b4e67 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:02.139751 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:02.160362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634be1e2-ab98-4678-86ba-52f867f042cf service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:02.284211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:02.284894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:02.285180 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:02.285463 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] PATH_INFO: `/v3/users/e741be9ad615437d965ba3522266b8ff` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:02.286759 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e741be9ad615437d965ba3522266b8ff)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:02.289674 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:02.383915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e741be9ad615437d965ba3522266b8ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.429416 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e741be9ad615437d965ba3522266b8ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.468838 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e741be9ad615437d965ba3522266b8ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.473069 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e741be9ad615437d965ba3522266b8ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.492534 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b2af703f-2245-47a2-a30e-db4c8aed21f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e741be9ad615437d965ba3522266b8ff'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:02.504311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1415/2828] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:02 2022] DELETE /identity/v3/users/e741be9ad615437d965ba3522266b8ff => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:41:02.974646 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:02.977033 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:02.998982 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7a8fd-8cc5-4671-be7a-ddbe40adb588 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:03.096229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:03.096920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.097201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.097490 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] PATH_INFO: `/v3/projects/9ad7fb27c6f24439b355a5b409aa1c2a` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.099450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad7fb27c6f24439b355a5b409aa1c2a)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:03.102227 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:03.184489 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad7fb27c6f24439b355a5b409aa1c2a', 'request_id': 'req-f47b1be0-a993-4b11-9ea5-160f8e426b42'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:03.193492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad7fb27c6f24439b355a5b409aa1c2a', 'request_id': 'req-f47b1be0-a993-4b11-9ea5-160f8e426b42'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:03.197865 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:03.207094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad7fb27c6f24439b355a5b409aa1c2a', 'request_id': 'req-f47b1be0-a993-4b11-9ea5-160f8e426b42'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:03.229655 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] The token cache is being invalidate because project 9ad7fb27c6f24439b355a5b409aa1c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:03.230128 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:03.231152 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-f47b1be0-a993-4b11-9ea5-160f8e426b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:03.233764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1414/2829] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:02 2022] DELETE /identity/v3/projects/9ad7fb27c6f24439b355a5b409aa1c2a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:03.241446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6029545-a27c-403f-8d6f-6b06d9f39bd8 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.242281 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6029545-a27c-403f-8d6f-6b06d9f39bd8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.242831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6029545-a27c-403f-8d6f-6b06d9f39bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.267530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-a6029545-a27c-403f-8d6f-6b06d9f39bd8 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:03.268820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-a6029545-a27c-403f-8d6f-6b06d9f39bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:03.337686 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:03.357444 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1416/2830] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:41:03.366531 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74728a-24f4-4bde-bfc5-13f413a8d789 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.366859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74728a-24f4-4bde-bfc5-13f413a8d789 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.367141 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74728a-24f4-4bde-bfc5-13f413a8d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.400703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-4b74728a-24f4-4bde-bfc5-13f413a8d789 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:03.402430 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4b74728a-24f4-4bde-bfc5-13f413a8d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:03.414726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1415/2831] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:03.421584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6029545-a27c-403f-8d6f-6b06d9f39bd8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:03.440560 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6029545-a27c-403f-8d6f-6b06d9f39bd8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:03.449572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:03.450284 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.450605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.451143 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.452537 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:41:03.452966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:03.455327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:03.485645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1417/2832] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:41:03.488057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74728a-24f4-4bde-bfc5-13f413a8d789 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:03.510057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74728a-24f4-4bde-bfc5-13f413a8d789 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:03.544576 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:03.545608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.546057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.546523 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.547524 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:03.550389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:03.590902 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1416/2833] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:41:03 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:41:03.596578 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:03.608423 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bdd1c-19fd-4f08-8781-91e29450d087 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:03.692807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:03.694450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.694450 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.695483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.696204 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:03.699916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:03.733966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1418/2834] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:41:03 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:41:03.735603 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:03.755481 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009eee8-9d1a-4c03-b9f2-ab60de130ad0 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:03.764171 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:03.765849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.765849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.765849 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.766677 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:03.769756 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:03.795911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1417/2835] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:03.800252 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:03.819269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac38e6e-b430-46e8-b786-8d28c6688ad3 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:03.828036 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37332205-5cdb-4b2d-975c-b3b669789fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:03.829213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332205-5cdb-4b2d-975c-b3b669789fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.829763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332205-5cdb-4b2d-975c-b3b669789fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.830365 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332205-5cdb-4b2d-975c-b3b669789fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.831807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37332205-5cdb-4b2d-975c-b3b669789fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:03.834899 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37332205-5cdb-4b2d-975c-b3b669789fa6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:03.851300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1419/2836] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:41:03.856318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:03.870888 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e9c97-4270-458d-b746-d4f85c270a9d admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:03.876854 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:03.877847 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.878223 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.878690 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] PATH_INFO: `/v3/projects/a4b71c6480a9419e9396026ecefc21ce/users/55f6b583c80a47a6a47f8e92c25882eb/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:03.908320 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b71c6480a9419e9396026ecefc21ce, user_id=55f6b583c80a47a6a47f8e92c25882eb, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:03.920028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:03.937674 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1418/2837] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:41:03 2022] PUT /identity/v3/projects/a4b71c6480a9419e9396026ecefc21ce/users/55f6b583c80a47a6a47f8e92c25882eb/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:41:03.956952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa8af2-db0a-4efc-8731-0879d71d7461 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:03.957602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa8af2-db0a-4efc-8731-0879d71d7461 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:03.958127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa8af2-db0a-4efc-8731-0879d71d7461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.017704 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-29fa8af2-db0a-4efc-8731-0879d71d7461 None None] MFA Rules not processed for user `55f6b583c80a47a6a47f8e92c25882eb`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:04.019953 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-29fa8af2-db0a-4efc-8731-0879d71d7461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:04.114551 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1420/2838] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:41:04.116631 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:04.198457 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155d44c-e7d4-4918-b57a-69f940efb974 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:04.203375 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:04.204057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:04.204342 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:04.204613 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.205297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:04.207235 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:04.240557 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1419/2839] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:41:04 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:41:04.246041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa8af2-db0a-4efc-8731-0879d71d7461 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:04.273630 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa8af2-db0a-4efc-8731-0879d71d7461 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:04.365601 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:04.413098 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:04.415400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:04.416160 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:04.416716 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.418822 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:04.425802 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:04.476310 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1421/2840] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:41:04 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:41:04.483197 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:04.502277 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39298843-d6ea-4624-b117-87742d211589 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:04.510726 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:04.511693 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:04.512168 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:04.512428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.513615 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:04.515450 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:04.533640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1420/2841] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:04.540462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:04.559380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9a456-bcaa-4736-a8c3-4dbb1590dcd9 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:04.567805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:04.568783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:04.569176 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:04.569567 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] PATH_INFO: `/v3/projects/b3524d2b368d4d35ac19ba13da908980/users/e162b713c5f049f089dd9b0719fe238c/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.596917 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3524d2b368d4d35ac19ba13da908980, user_id=e162b713c5f049f089dd9b0719fe238c, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:04.600894 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:04.620592 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1422/2842] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:41:04 2022] PUT /identity/v3/projects/b3524d2b368d4d35ac19ba13da908980/users/e162b713c5f049f089dd9b0719fe238c/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:04.625876 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:04.639204 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce2be9-7061-499c-840f-ff9d786b657f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:04.701958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:04.714593 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843b606-bc06-4f0c-84df-152beb605b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:04.716625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b606-bc06-4f0c-84df-152beb605b72 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:04.718587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b606-bc06-4f0c-84df-152beb605b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:04.719233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b606-bc06-4f0c-84df-152beb605b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.720665 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843b606-bc06-4f0c-84df-152beb605b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:04.723859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843b606-bc06-4f0c-84df-152beb605b72 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:04.739046 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1421/2843] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:04.744387 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:04.765632 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f930032-0ae0-463d-9b63-5c54362ae1d3 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:04.774106 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:04.775297 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:04.775890 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:04.776390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] PATH_INFO: `/v3/projects/b3524d2b368d4d35ac19ba13da908980/users/e162b713c5f049f089dd9b0719fe238c/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.780010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3524d2b368d4d35ac19ba13da908980, user_id=e162b713c5f049f089dd9b0719fe238c, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:04.785403 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:04.803970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1423/2844] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:41:04 2022] PUT /identity/v3/projects/b3524d2b368d4d35ac19ba13da908980/users/e162b713c5f049f089dd9b0719fe238c/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:04.878035 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4bc10-59a8-4100-9b7a-a0ef86cd9292 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:04.878272 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4bc10-59a8-4100-9b7a-a0ef86cd9292 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:04.878487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4bc10-59a8-4100-9b7a-a0ef86cd9292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:04.924404 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-bea4bc10-59a8-4100-9b7a-a0ef86cd9292 None None] MFA Rules not processed for user `e162b713c5f049f089dd9b0719fe238c`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:04.926586 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-bea4bc10-59a8-4100-9b7a-a0ef86cd9292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:05.076057 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1422/2845] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:05.093865 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:05.095924 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:05.198752 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021364fa-f538-44a2-b51a-fd1b59a3a922 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:05.205051 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:05.206391 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:05.206892 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:05.207222 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:05.310817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:05.313599 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:05.330039 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1424/2846] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:05.841554 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:05.842454 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:05.842671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:05.877970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:05.880174 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:05.972442 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1423/2847] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 28 06:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:05.998952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:06.001763 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:06.096291 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:06.129530 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44353a85-5cfb-4cff-ab73-37f5bb22f0aa service cinder] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:06.133145 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:06.133638 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:06.133913 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:06.134183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:06.143870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:06.145644 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:06.156269 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1425/2848] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:06.425544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:06.428165 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:06.498918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e062e6c-8e5d-49fa-8694-36556abd5a4b None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:06.503149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88f64c-7e3b-4885-89ef-ec2365f580ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:06.503911 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f64c-7e3b-4885-89ef-ec2365f580ba service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:06.504232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f64c-7e3b-4885-89ef-ec2365f580ba service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:06.504543 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f64c-7e3b-4885-89ef-ec2365f580ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:06.506473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8d88f64c-7e3b-4885-89ef-ec2365f580ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:06.526009 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88f64c-7e3b-4885-89ef-ec2365f580ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:06.528544 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88f64c-7e3b-4885-89ef-ec2365f580ba service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:06.544618 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1424/2849] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:08.163174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:08.180041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f56cd-af99-449f-bd45-e8dea8e4f84f service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:08.185271 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:08.185938 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:08.186218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:08.186496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] PATH_INFO: `/v3/users/55f6b583c80a47a6a47f8e92c25882eb` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:08.187809 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f6b583c80a47a6a47f8e92c25882eb)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:08.189783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:08.250909 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f6b583c80a47a6a47f8e92c25882eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:08.270483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f6b583c80a47a6a47f8e92c25882eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:08.281030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f6b583c80a47a6a47f8e92c25882eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:08.282113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f6b583c80a47a6a47f8e92c25882eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:08.306120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f6b583c80a47a6a47f8e92c25882eb'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:08.319195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1426/2850] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:08 2022] DELETE /identity/v3/users/55f6b583c80a47a6a47f8e92c25882eb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:08.325724 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:08.326551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:08.326974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:08.358828 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:08.360282 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:08.385831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=100 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:08.468241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1425/2851] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:08.478950 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:08.480555 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:08.558328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879d239-7cbe-41b9-8b70-fb774cd314d9 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:08.563193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:08.564190 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:08.564419 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:08.564641 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:08.576915 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:08.578579 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:08.589888 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1427/2852] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:41:09.034198 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:09.036237 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:09.063792 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea61d-327b-4037-93d4-be84d8e20851 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:09.081624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:09.083640 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:09.084155 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:09.086242 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] PATH_INFO: `/v3/projects/a4b71c6480a9419e9396026ecefc21ce` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:09.088629 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b71c6480a9419e9396026ecefc21ce)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:09.094429 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:09.202340 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b71c6480a9419e9396026ecefc21ce', 'request_id': 'req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.222239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b71c6480a9419e9396026ecefc21ce', 'request_id': 'req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.236432 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b71c6480a9419e9396026ecefc21ce', 'request_id': 'req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.252193 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] The token cache is being invalidate because project a4b71c6480a9419e9396026ecefc21ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:09.252790 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.253656 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.257362 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1426/2853] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:09 2022] DELETE /identity/v3/projects/a4b71c6480a9419e9396026ecefc21ce => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:09.261358 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:09.276831 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1970a2a-8513-4616-b25c-9f51af8a9b48 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:09.372925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:09.385087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:09.386487 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:09.387328 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:09.388170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] PATH_INFO: `/v3/users/e162b713c5f049f089dd9b0719fe238c` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:09.391425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e162b713c5f049f089dd9b0719fe238c)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:09.396553 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:09.516540 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e162b713c5f049f089dd9b0719fe238c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.580516 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e162b713c5f049f089dd9b0719fe238c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.600496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e162b713c5f049f089dd9b0719fe238c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.601536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e162b713c5f049f089dd9b0719fe238c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.624429 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7a2139c5-9aa5-4fcc-a5fe-1af40b9705da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e162b713c5f049f089dd9b0719fe238c'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:09.646286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1428/2854] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:09 2022] DELETE /identity/v3/users/e162b713c5f049f089dd9b0719fe238c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:10.237224 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:10.239958 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:10.261852 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec815c4-53bd-4b85-a8c8-a7ec64b80797 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:10.429831 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:10.431072 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:10.431943 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:10.432311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] PATH_INFO: `/v3/projects/b3524d2b368d4d35ac19ba13da908980` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:10.435109 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3524d2b368d4d35ac19ba13da908980)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:10.437566 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:10.528215 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:10.533823 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3524d2b368d4d35ac19ba13da908980', 'request_id': 'req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:10.553302 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3524d2b368d4d35ac19ba13da908980', 'request_id': 'req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:10.572637 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3524d2b368d4d35ac19ba13da908980', 'request_id': 'req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:10.604553 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] The token cache is being invalidate because project b3524d2b368d4d35ac19ba13da908980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:10.605149 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:10.606288 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-8f3599ad-2a8f-42e5-9ac9-9867f4f5e564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:10.614347 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1427/2855] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:10 2022] DELETE /identity/v3/projects/b3524d2b368d4d35ac19ba13da908980 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:10.617215 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277b1df-1240-4d23-afc0-586d1de21239 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:10.618497 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277b1df-1240-4d23-afc0-586d1de21239 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:10.619254 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277b1df-1240-4d23-afc0-586d1de21239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:10.670731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-8277b1df-1240-4d23-afc0-586d1de21239 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:10.673488 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8277b1df-1240-4d23-afc0-586d1de21239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:10.827910 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1429/2856] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:10.835989 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d613c-c694-4587-8a79-312031ab61bc None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:10.836166 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d613c-c694-4587-8a79-312031ab61bc None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:10.836632 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d613c-c694-4587-8a79-312031ab61bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:10.894497 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-311d613c-c694-4587-8a79-312031ab61bc None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:10.896383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-311d613c-c694-4587-8a79-312031ab61bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:10.913435 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1428/2857] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:41:10.919136 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277b1df-1240-4d23-afc0-586d1de21239 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:10.937322 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277b1df-1240-4d23-afc0-586d1de21239 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:10.946541 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:10.948466 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:10.949213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:10.950402 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:10.952081 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:41:10.952905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:10.956483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:10.982037 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1430/2858] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:41:10.986996 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d613c-c694-4587-8a79-312031ab61bc None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:11.025517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d613c-c694-4587-8a79-312031ab61bc None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:11.053107 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:11.054031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.055477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.056056 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.060045 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:11.064471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:11.121506 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1429/2859] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:41:10 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:41:11.125813 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:11.149576 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbb302-9ae9-410f-91d8-4d781bda9e98 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:11.256195 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:11.256860 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.257151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.257436 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] PATH_INFO: `/v3/users` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.258100 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:11.260179 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:11.271955 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:11.303872 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1431/2860] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:41:11 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:41:11.306008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:11.318513 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0b4b8-2674-4648-8989-e7d94f371d0f admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:11.324779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:11.325698 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.326164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.326433 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.327311 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:11.329013 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:11.351822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1430/2861] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:11.354023 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:11.359686 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:11.362125 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:11.377853 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19545227-3ce4-42f7-a63b-de936a9feb0d admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:11.394102 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:11.395562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.411164 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.412830 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.416390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:11.420286 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:11.454330 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1432/2862] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:11.463885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:11.483970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32c8ad-798c-47d7-bccf-4e6044a1d937 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:11.491988 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deee42-3626-462c-951b-610e5beb955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:11.492760 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deee42-3626-462c-951b-610e5beb955a admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.493045 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deee42-3626-462c-951b-610e5beb955a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.493390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deee42-3626-462c-951b-610e5beb955a admin admin] PATH_INFO: `/v3/projects/4e4d7aaad1164d53b504c5b25810402a/users/d90fc69727054d3f82d692ce2ce600ca/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.521916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deee42-3626-462c-951b-610e5beb955a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4d7aaad1164d53b504c5b25810402a, user_id=d90fc69727054d3f82d692ce2ce600ca, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:11.525189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deee42-3626-462c-951b-610e5beb955a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:11.530354 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf302f6-8194-4cb3-8826-6c98c03ee633 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:11.539874 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:11.541008 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.541484 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.541970 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.545307 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:11.570339 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1433/2863] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:41:11 2022] PUT /identity/v3/projects/4e4d7aaad1164d53b504c5b25810402a/users/d90fc69727054d3f82d692ce2ce600ca/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:11.570583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:11.574455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:11.589563 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dada0-f124-41d8-a8a0-fb649b1c2d5a None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.589991 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dada0-f124-41d8-a8a0-fb649b1c2d5a None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.590482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dada0-f124-41d8-a8a0-fb649b1c2d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.601580 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1431/2864] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:41:11.652099 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-cc7dada0-f124-41d8-a8a0-fb649b1c2d5a None None] MFA Rules not processed for user `d90fc69727054d3f82d692ce2ce600ca`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:11.654371 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-cc7dada0-f124-41d8-a8a0-fb649b1c2d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:11.767427 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1434/2865] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:11.783974 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:11.786190 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:11.870031 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af94905-1ff5-4c50-8d57-e2f47139e384 service placement] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:11.902236 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:11.955164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda5e9-1379-42f8-9a66-fb7790a8dfc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c08bdb04cc146fa8f6c6bb626c30437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:11.955848 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda5e9-1379-42f8-9a66-fb7790a8dfc4 service cinder] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:11.956131 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda5e9-1379-42f8-9a66-fb7790a8dfc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:11.956408 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda5e9-1379-42f8-9a66-fb7790a8dfc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:11.966252 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda5e9-1379-42f8-9a66-fb7790a8dfc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:11.967822 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda5e9-1379-42f8-9a66-fb7790a8dfc4 service cinder] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:11.977742 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1432/2866] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:14.800456 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dada0-f124-41d8-a8a0-fb649b1c2d5a None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:14.923726 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dada0-f124-41d8-a8a0-fb649b1c2d5a None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:14.928022 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:14.928694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:14.928975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:14.929247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] PATH_INFO: `/v3/users/d90fc69727054d3f82d692ce2ce600ca` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:14.930693 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90fc69727054d3f82d692ce2ce600ca)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:14.933346 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:15.030861 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90fc69727054d3f82d692ce2ce600ca'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:15.048936 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:15.051009 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90fc69727054d3f82d692ce2ce600ca'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:15.069958 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90fc69727054d3f82d692ce2ce600ca'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:15.072364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90fc69727054d3f82d692ce2ce600ca'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:15.095952 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90fc69727054d3f82d692ce2ce600ca'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:15.115493 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1435/2867] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:14 2022] DELETE /identity/v3/users/d90fc69727054d3f82d692ce2ce600ca => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:15.117164 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:15.117672 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:15.117977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:15.147087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:15.148871 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:15.255921 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1433/2868] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:15.274653 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:15.277369 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:15.438668 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e813-3ea2-4ac8-bf39-94d2e8231790 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:15.446925 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:15.448213 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:15.448786 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:15.449240 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:15.465529 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:15.468086 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:15.482607 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1436/2869] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:15.944495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:15.947108 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:15.968512 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579337fc-01b9-4808-b77b-dbaf9600bbc7 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:15.977195 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:15.978391 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:15.978879 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:15.979365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] PATH_INFO: `/v3/projects/4e4d7aaad1164d53b504c5b25810402a` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:15.981621 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4d7aaad1164d53b504c5b25810402a)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:15.985853 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:16.092516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4d7aaad1164d53b504c5b25810402a', 'request_id': 'req-64ba666a-5681-4d05-aab8-2bc3f2984a51'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.100185 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4d7aaad1164d53b504c5b25810402a', 'request_id': 'req-64ba666a-5681-4d05-aab8-2bc3f2984a51'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.111142 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4d7aaad1164d53b504c5b25810402a', 'request_id': 'req-64ba666a-5681-4d05-aab8-2bc3f2984a51'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.124563 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] The token cache is being invalidate because project 4e4d7aaad1164d53b504c5b25810402a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:16.125267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.126308 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.127965 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1434/2870] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:15 2022] DELETE /identity/v3/projects/4e4d7aaad1164d53b504c5b25810402a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:16.554174 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:16.560033 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:16.577321 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e029fdd-9a54-49c3-8eb6-ef077392dc66 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:16.634600 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:16.636893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:16.661376 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:16.662296 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:16.662863 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:16.663398 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] PATH_INFO: `/v3/users/c80c052b0a194c9487ca3314f4f2b8d5` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:16.665873 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80c052b0a194c9487ca3314f4f2b8d5)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:16.669380 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:16.707846 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:16.730713 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80c052b0a194c9487ca3314f4f2b8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.733125 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:16.735398 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba666a-5681-4d05-aab8-2bc3f2984a51 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:16.744517 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:16.745337 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:16.746473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:16.746473 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:16.749752 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:16.755132 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80c052b0a194c9487ca3314f4f2b8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.765041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:16.765734 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80c052b0a194c9487ca3314f4f2b8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.766482 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80c052b0a194c9487ca3314f4f2b8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.766780 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:16.775975 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80c052b0a194c9487ca3314f4f2b8d5'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:16.783446 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1437/2871] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:16 2022] DELETE /identity/v3/users/c80c052b0a194c9487ca3314f4f2b8d5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:16.785664 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1435/2872] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:17.020175 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:17.037489 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:17.130885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f7d23-8b3a-4cfa-8f79-2d9bb869f85c admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:17.135999 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:17.136575 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:17.136856 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:17.137133 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] PATH_INFO: `/v3/projects/b509c396597344248cbc5dfcdc33eb31` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:17.138311 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b509c396597344248cbc5dfcdc33eb31)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:17.140300 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:17.207411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b509c396597344248cbc5dfcdc33eb31', 'request_id': 'req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.216645 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b509c396597344248cbc5dfcdc33eb31', 'request_id': 'req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.233515 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b509c396597344248cbc5dfcdc33eb31', 'request_id': 'req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.251978 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] The token cache is being invalidate because project b509c396597344248cbc5dfcdc33eb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:17.252447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.253552 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.255354 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1438/2873] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:17 2022] DELETE /identity/v3/projects/b509c396597344248cbc5dfcdc33eb31 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:17.261419 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:17.263049 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:17.279239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a13-567d-4457-a7b1-72738c01e869 service placement] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:17.378736 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:17.379539 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:17.379930 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:17.380241 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] PATH_INFO: `/v3/users/0aac93785bae41b3a819c523f303944d` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:17.381607 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aac93785bae41b3a819c523f303944d)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:17.383791 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:17.444393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aac93785bae41b3a819c523f303944d'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.458987 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aac93785bae41b3a819c523f303944d'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.460028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aac93785bae41b3a819c523f303944d'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.470703 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aac93785bae41b3a819c523f303944d'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.479351 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aac93785bae41b3a819c523f303944d'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.486051 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1436/2874] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:17 2022] DELETE /identity/v3/users/0aac93785bae41b3a819c523f303944d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:17.739011 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:17.741690 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:17.760085 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533d1ee-4945-441b-8abc-d89ddb0c8c9a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:17.842058 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:17.852620 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:17.853817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:17.854662 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:17.855504 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] PATH_INFO: `/v3/projects/56cc17add9ef413e94f10db78a676b68` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:17.858319 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cc17add9ef413e94f10db78a676b68)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:17.868053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:17.965225 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cc17add9ef413e94f10db78a676b68', 'request_id': 'req-b5b1fa39-4ea8-4298-b341-3eaf475065d1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.973317 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cc17add9ef413e94f10db78a676b68', 'request_id': 'req-b5b1fa39-4ea8-4298-b341-3eaf475065d1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.984985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cc17add9ef413e94f10db78a676b68', 'request_id': 'req-b5b1fa39-4ea8-4298-b341-3eaf475065d1'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:17.999562 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] The token cache is being invalidate because project 56cc17add9ef413e94f10db78a676b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:17.999967 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:18.000778 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:18.002572 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1439/2875] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:17 2022] DELETE /identity/v3/projects/56cc17add9ef413e94f10db78a676b68 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:27.482257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:27.995424 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:36.312872 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:36.319393 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:36.338060 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfe6a4-9dad-4624-ad59-6981f38edfb8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:36.427761 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:36.428825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:36.429291 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:36.429766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] PATH_INFO: `/v3/users/91db3c87c9594d1baa1404b471ab5963` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:36.431641 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91db3c87c9594d1baa1404b471ab5963)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:36.433760 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:36.494893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91db3c87c9594d1baa1404b471ab5963'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.513692 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91db3c87c9594d1baa1404b471ab5963'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.514477 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91db3c87c9594d1baa1404b471ab5963'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.525486 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91db3c87c9594d1baa1404b471ab5963'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.533776 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-d72c91dc-eb02-4426-beae-541d9462e553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91db3c87c9594d1baa1404b471ab5963'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.540372 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1437/2876] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:41:36 2022] DELETE /identity/v3/users/91db3c87c9594d1baa1404b471ab5963 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:36.759314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:36.761605 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:36.787916 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1fa39-4ea8-4298-b341-3eaf475065d1 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:36.874288 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:36.875218 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:36.875609 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:36.876092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] PATH_INFO: `/v3/projects/b99a53e2cfda4ed0aa225eae423a2bea` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:36.878336 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99a53e2cfda4ed0aa225eae423a2bea)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:36.882245 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:36.958680 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99a53e2cfda4ed0aa225eae423a2bea', 'request_id': 'req-64a06140-6142-4b6d-b756-853b813d7f97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.966587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99a53e2cfda4ed0aa225eae423a2bea', 'request_id': 'req-64a06140-6142-4b6d-b756-853b813d7f97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.976586 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99a53e2cfda4ed0aa225eae423a2bea', 'request_id': 'req-64a06140-6142-4b6d-b756-853b813d7f97'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.988846 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] The token cache is being invalidate because project b99a53e2cfda4ed0aa225eae423a2bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:41:36.989183 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.989795 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-64a06140-6142-4b6d-b756-853b813d7f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:41:36.991377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1440/2877] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:41:36 2022] DELETE /identity/v3/projects/b99a53e2cfda4ed0aa225eae423a2bea => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:36.996816 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ac982-6eeb-49be-9080-495ad3409d43 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:36.997087 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ac982-6eeb-49be-9080-495ad3409d43 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:36.997343 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ac982-6eeb-49be-9080-495ad3409d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.019571 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-817ac982-6eeb-49be-9080-495ad3409d43 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:37.021201 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-817ac982-6eeb-49be-9080-495ad3409d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:37.107465 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1438/2878] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:37.115405 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb0e1-35d5-4dba-941f-634c0948cae1 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.115715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb0e1-35d5-4dba-941f-634c0948cae1 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.116006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb0e1-35d5-4dba-941f-634c0948cae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.137580 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d38bb0e1-35d5-4dba-941f-634c0948cae1 None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:37.138833 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d38bb0e1-35d5-4dba-941f-634c0948cae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:37.149306 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1441/2879] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:37.154681 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ac982-6eeb-49be-9080-495ad3409d43 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:37.167041 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ac982-6eeb-49be-9080-495ad3409d43 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:37.175145 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:37.175867 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.176249 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.176653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.177894 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:41:37.178382 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:37.181267 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:37.196609 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1439/2880] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Jul 28 06:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:41:37.201729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb0e1-35d5-4dba-941f-634c0948cae1 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:37.211935 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb0e1-35d5-4dba-941f-634c0948cae1 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:37.216820 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:37.217467 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.217750 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.218028 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.218719 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:37.220731 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:37.252538 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1442/2881] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:41:37 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:41:37.257301 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:37.268297 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870db03-565a-4c22-a6ba-d86e24f2e8d6 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:37.272673 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:37.338232 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:37.339075 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.339271 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.339455 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.340218 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:37.342239 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:37.366402 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1440/2882] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:41:37 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:41:37.370870 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:37.387120 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385071-7113-43e2-b5b4-3d7acb4dca2f admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:37.394987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:37.396123 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.396547 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.397021 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.398087 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:37.401010 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:37.418364 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1443/2883] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:37.423718 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:37.436220 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca4d74-030c-4d98-83a5-dda89d807d57 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:37.442118 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d39b-7ce2-4e62-b3a9-d49d643d1bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:37.442815 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d39b-7ce2-4e62-b3a9-d49d643d1bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.443139 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d39b-7ce2-4e62-b3a9-d49d643d1bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.443458 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d39b-7ce2-4e62-b3a9-d49d643d1bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.444305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d39b-7ce2-4e62-b3a9-d49d643d1bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:37.446003 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d39b-7ce2-4e62-b3a9-d49d643d1bf8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:37.458905 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1441/2884] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:37.463905 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:37.480247 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e8e8-09b1-4a91-8292-ab0e5be4827a admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:37.488411 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:37.489483 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] REQUEST_METHOD: `PUT` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.489959 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.490370 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] PATH_INFO: `/v3/projects/e11fb7989b684c29ab6b9d7b398ce1ff/users/02df7fe1748e40f0b62eb65e7f19a9c4/roles/d02524abaa4649c8bd246eac91a4f773` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.518041 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11fb7989b684c29ab6b9d7b398ce1ff, user_id=02df7fe1748e40f0b62eb65e7f19a9c4, role_id=d02524abaa4649c8bd246eac91a4f773)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:37.523024 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:37.538768 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1444/2885] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:41:37 2022] PUT /identity/v3/projects/e11fb7989b684c29ab6b9d7b398ce1ff/users/02df7fe1748e40f0b62eb65e7f19a9c4/roles/d02524abaa4649c8bd246eac91a4f773 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:37.544178 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cbbf2-3dde-4865-a099-dec17463818c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.544516 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cbbf2-3dde-4865-a099-dec17463818c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.544794 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cbbf2-3dde-4865-a099-dec17463818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.566711 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-664cbbf2-3dde-4865-a099-dec17463818c None None] MFA Rules not processed for user `aa34501abc84417abc9f42b1fba8ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:37.568219 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-664cbbf2-3dde-4865-a099-dec17463818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:37.660929 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1442/2886] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:37.673327 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:37.676390 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:37.726377 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:37.758761 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006afcf-b7d0-4f52-ab6c-fab700872011 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:37.763229 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:37.764264 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:37.764640 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:37.765006 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:37.775887 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:37.777594 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:37.788602 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1445/2887] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:41:43.183842 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ef37e-2d4c-4967-8a31-2e57c513df3c None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:43.184707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ef37e-2d4c-4967-8a31-2e57c513df3c None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:43.184707 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ef37e-2d4c-4967-8a31-2e57c513df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:43.228608 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-e53ef37e-2d4c-4967-8a31-2e57c513df3c None None] MFA Rules not processed for user `02df7fe1748e40f0b62eb65e7f19a9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:43.229897 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e53ef37e-2d4c-4967-8a31-2e57c513df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:43.333006 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1443/2888] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:43.339807 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:43.351092 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a1b4a-6a1b-4f14-95ba-f5d193ada935 service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:43.356841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:43.357513 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:43.357841 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:43.358181 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:43.358914 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:43.361277 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:43.395233 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1446/2889] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Jul 28 06:41:43 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:41:43.400735 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ef37e-2d4c-4967-8a31-2e57c513df3c None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:43.422625 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ef37e-2d4c-4967-8a31-2e57c513df3c None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:43.443124 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:43.524611 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:43.525688 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:43.526229 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:43.526712 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] PATH_INFO: `/v3/users` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:43.528040 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:43.531932 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:43.567731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1444/2890] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Jul 28 06:41:43 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:41:43.572301 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:43.593520 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e25d-baef-4045-85d6-67a9081f43d6 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:43.602127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:43.602885 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:43.603167 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:43.603474 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:43.604613 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:43.607067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:43.622972 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1447/2891] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:41:43.628305 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:43.645990 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78392e03-ed1a-45f0-b2c9-08af573feb2c admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:43.655018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:43.656036 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:43.656551 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:43.657018 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] PATH_INFO: `/v3/projects/407583643a5a4aebaf15ba89904ed049/users/4399d077510a48fa91472eb7111c799f/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:43.679680 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407583643a5a4aebaf15ba89904ed049, user_id=4399d077510a48fa91472eb7111c799f, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:43.683389 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:43.707230 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1445/2892] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:41:43 2022] PUT /identity/v3/projects/407583643a5a4aebaf15ba89904ed049/users/4399d077510a48fa91472eb7111c799f/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:43.713020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:43.733539 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349cf1a-2172-4ff1-baa3-bc5a1372be73 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:43.810584 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b2e20-4fab-4003-b688-390fc98457f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:43.811285 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b2e20-4fab-4003-b688-390fc98457f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:43.811598 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b2e20-4fab-4003-b688-390fc98457f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:43.812095 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b2e20-4fab-4003-b688-390fc98457f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:43.813109 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b2e20-4fab-4003-b688-390fc98457f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:43.815536 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b2e20-4fab-4003-b688-390fc98457f1 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:43.829627 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1448/2893] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Jul 28 06:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:41:43.835388 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:43.851570 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3309bec-644e-4f37-974f-dfecb5fc9473 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:43.857428 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:43.858487 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] REQUEST_METHOD: `PUT` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:43.858980 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:43.859471 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] PATH_INFO: `/v3/projects/407583643a5a4aebaf15ba89904ed049/users/4399d077510a48fa91472eb7111c799f/roles/af3b62eec1004adc904a4c278710faee` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:43.863364 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407583643a5a4aebaf15ba89904ed049, user_id=4399d077510a48fa91472eb7111c799f, role_id=af3b62eec1004adc904a4c278710faee)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:43.868606 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:43.888969 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1446/2894] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Jul 28 06:41:43 2022] PUT /identity/v3/projects/407583643a5a4aebaf15ba89904ed049/users/4399d077510a48fa91472eb7111c799f/roles/af3b62eec1004adc904a4c278710faee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:41:50.462314 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ef544-5de3-42e9-b3f5-bf6bd4d4de93 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:50.463151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ef544-5de3-42e9-b3f5-bf6bd4d4de93 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:50.463151 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ef544-5de3-42e9-b3f5-bf6bd4d4de93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:50.496673 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-905ef544-5de3-42e9-b3f5-bf6bd4d4de93 None None] MFA Rules not processed for user `4399d077510a48fa91472eb7111c799f`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:50.498147 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-905ef544-5de3-42e9-b3f5-bf6bd4d4de93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:50.599508 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1449/2895] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:41:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:50.628663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:50.628663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:50.721011 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d885f7-f647-4e88-9918-88571390ce14 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:50.725099 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1e0e81d0ee04020b43c28347ef3ab6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:50.725764 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:50.726062 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:50.726341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:50.825069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:50.827715 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:50.842446 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1447/2896] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:41:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:41:51.007814 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2497ba4-f552-427d-8dab-26169dca2845 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:51.008282 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2497ba4-f552-427d-8dab-26169dca2845 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:51.008694 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2497ba4-f552-427d-8dab-26169dca2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:51.042687 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-d2497ba4-f552-427d-8dab-26169dca2845 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:41:51.044031 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-d2497ba4-f552-427d-8dab-26169dca2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:51.048987 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:51.106241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1450/2897] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:41:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:41:51.176977 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:41:51.178810 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:41:51.220028 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:51.291519 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1de5-1f3a-48c3-bd6a-23a23f35a24a service glance] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:41:51.297341 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddebba-adfc-4e88-ab71-b9018feb98e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:41:51.297981 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddebba-adfc-4e88-ab71-b9018feb98e7 service swift] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:41:51.298257 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddebba-adfc-4e88-ab71-b9018feb98e7 service swift] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:41:51.298529 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddebba-adfc-4e88-ab71-b9018feb98e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:41:51.308365 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddebba-adfc-4e88-ab71-b9018feb98e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:41:51.310017 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddebba-adfc-4e88-ab71-b9018feb98e7 service swift] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:41:51.320016 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1448/2898] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:41:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:42:01.095979 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=21 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:01.195490 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f80728-cf7b-49a0-8bd2-50723ca612f8 None None] REQUEST_METHOD: `POST` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:42:01.196049 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f80728-cf7b-49a0-8bd2-50723ca612f8 None None] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:42:01.196544 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f80728-cf7b-49a0-8bd2-50723ca612f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:42:01.221340 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.auth.core [None req-64f80728-cf7b-49a0-8bd2-50723ca612f8 None None] MFA Rules not processed for user `02df7fe1748e40f0b62eb65e7f19a9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=89167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:42:01.223304 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-64f80728-cf7b-49a0-8bd2-50723ca612f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:42:01.231545 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1451/2899] 10.222.0.58 () {58 vars in 958 bytes} [Thu Jul 28 06:42:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:42:01.315719 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=22 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:03.502445 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:42:03.503233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:42:03.503233 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:42:03.525663 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:42:03.528731 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:42:03.541568 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1449/2900] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Jul 28 06:42:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:42:03.555193 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f80728-cf7b-49a0-8bd2-50723ca612f8 None None] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:42:03.569521 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f80728-cf7b-49a0-8bd2-50723ca612f8 None None] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:42:03.575881 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:42:03.576966 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:42:03.577316 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:42:03.577658 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:42:03.587337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:42:03.589141 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:42:03.599394 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1452/2901] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:42:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:42:13.518766 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=3 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:13.595347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=9 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:24.173136 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:42:24.174782 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:42:24.235859 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc31ea-e242-4c87-8698-19ed088f6b43 None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:42:24.239658 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:42:24.240309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:42:24.240583 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:42:24.240856 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:42:24.250900 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:42:24.252533 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:42:24.263383 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1450/2902] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:42:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:42:34.258671 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=26 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:59.073647 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:42:59.085224 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe976a8-583e-43d6-b8c8-a0a471d749f5 service swift] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:42:59.089985 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:42:59.090618 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:42:59.090900 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:42:59.091170 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:42:59.093211 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:42:59.190691 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:42:59.192970 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:42:59.208189 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1453/2903] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:42:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:43:00.428478 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:00.442877 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c44b-9c4a-4966-8509-0269c008fdd8 service neutron] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:00.447510 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d26e1-8dc6-4f40-a9c7-b215ca70590b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c206251915e74dba98b9422cf2f026d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:00.448309 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d26e1-8dc6-4f40-a9c7-b215ca70590b service neutron] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:00.448918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d26e1-8dc6-4f40-a9c7-b215ca70590b service neutron] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:00.448918 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d26e1-8dc6-4f40-a9c7-b215ca70590b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:00.450804 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-e25d26e1-8dc6-4f40-a9c7-b215ca70590b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:00.466026 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d26e1-8dc6-4f40-a9c7-b215ca70590b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:00.467480 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d26e1-8dc6-4f40-a9c7-b215ca70590b service neutron] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:00.479781 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1451/2904] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:43:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:43:09.202030 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=34 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:10.474137 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=6 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:44.802146 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:44.809556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:44.832337 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164bc58-ebad-46ac-980f-c69405c60b4d service neutron] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:44.842067 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b5bd02365348098c1e7b448a996f12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:44.843191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:44.843773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:44.845134 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:44.848400 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:44.869128 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:44.872356 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:44.886263 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1454/2905] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:43:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:43:46.016369 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] REQUEST_METHOD: `POST` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:46.016893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:46.016893 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:46.080767 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.auth.core [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] MFA Rules not processed for user `2cce71bab5154b19887ae23af182f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:43:46.082010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:46.100098 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1452/2906] 10.222.0.58 () {58 vars in 967 bytes} [Thu Jul 28 06:43:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:43:46.145523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:46.172582 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863b58-9bb4-4c88-b291-27434aed9fd3 service nova] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:46.178824 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969f6ef78a6342e49325ea63f50b69ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:46.179462 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:46.179755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:46.180020 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:46.199643 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:46.201279 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:46.210715 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1455/2907] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Jul 28 06:43:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:43:50.153318 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:50.154991 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:50.264581 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730335f-f881-40ab-acd1-8c307bc03cad None None] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:50.273653 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:50.274313 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] REQUEST_METHOD: `GET` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:50.274602 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:50.274875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:50.277030 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:50.291574 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:50.293216 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:50.308875 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1453/2908] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:43:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:43:54.015241 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:54.097191 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4509553-9d3e-46e8-9d54-d3cae628b46f service swift] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:54.102188 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:54.102773 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:54.103053 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:54.103362 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] PATH_INFO: `/v3/users/02df7fe1748e40f0b62eb65e7f19a9c4` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:54.104729 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02df7fe1748e40f0b62eb65e7f19a9c4)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:54.106699 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:54.171333 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02df7fe1748e40f0b62eb65e7f19a9c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.186127 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02df7fe1748e40f0b62eb65e7f19a9c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.196587 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02df7fe1748e40f0b62eb65e7f19a9c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.197374 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02df7fe1748e40f0b62eb65e7f19a9c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.210072 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02df7fe1748e40f0b62eb65e7f19a9c4'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.217869 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1456/2909] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:43:54 2022] DELETE /identity/v3/users/02df7fe1748e40f0b62eb65e7f19a9c4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:43:54.442624 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:54.456425 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcc512-37df-4dd9-80e1-4f81be13694a service placement] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:54.523238 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:54.523941 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:54.524228 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:54.524495 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] PATH_INFO: `/v3/projects/e11fb7989b684c29ab6b9d7b398ce1ff` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:54.525789 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11fb7989b684c29ab6b9d7b398ce1ff)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:54.527777 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:54.591779 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11fb7989b684c29ab6b9d7b398ce1ff', 'request_id': 'req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.594010 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:54.599920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11fb7989b684c29ab6b9d7b398ce1ff', 'request_id': 'req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.610094 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11fb7989b684c29ab6b9d7b398ce1ff', 'request_id': 'req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.622825 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] The token cache is being invalidate because project e11fb7989b684c29ab6b9d7b398ce1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:43:54.623105 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.623920 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.626120 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1454/2910] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:43:54 2022] DELETE /identity/v3/projects/e11fb7989b684c29ab6b9d7b398ce1ff => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:43:54.631061 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:54.633080 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:54.647817 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5965a9-9ee0-4383-a6c5-d4f8db95ff12 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:54.694965 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:54.721859 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:54.722522 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:54.722796 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:54.723066 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] PATH_INFO: `/v3/users/4399d077510a48fa91472eb7111c799f` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:54.724406 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4399d077510a48fa91472eb7111c799f)` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:54.726375 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:54.782937 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4399d077510a48fa91472eb7111c799f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.799447 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4399d077510a48fa91472eb7111c799f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.806755 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4399d077510a48fa91472eb7111c799f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.807496 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4399d077510a48fa91472eb7111c799f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.818712 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.notifications [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4399d077510a48fa91472eb7111c799f'} {{(pid=89167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:54.826923 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1457/2911] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Jul 28 06:43:54 2022] DELETE /identity/v3/users/4399d077510a48fa91472eb7111c799f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:43:55.042496 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Authenticating user token {{(pid=89166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:43:55.044023 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.fernet_utils [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:43:55.059953 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fe673-aaae-4d69-a7bc-f0f26d7c8ab8 admin admin] Validating token access rules against request {{(pid=89166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:43:55.128587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa34501abc84417abc9f42b1fba8ece5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d9225d0fd499a885320253a91a4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:43:55.129069 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:43:55.129336 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:43:55.129633 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] PATH_INFO: `/v3/projects/407583643a5a4aebaf15ba89904ed049` {{(pid=89166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:43:55.131079 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=407583643a5a4aebaf15ba89904ed049)` {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:43:55.133053 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] RBAC: Authorization granted {{(pid=89166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:43:55.186744 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407583643a5a4aebaf15ba89904ed049', 'request_id': 'req-0ef971be-f9ee-4b43-b922-6ad33c0905ef'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:55.193587 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407583643a5a4aebaf15ba89904ed049', 'request_id': 'req-0ef971be-f9ee-4b43-b922-6ad33c0905ef'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:55.203217 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407583643a5a4aebaf15ba89904ed049', 'request_id': 'req-0ef971be-f9ee-4b43-b922-6ad33c0905ef'} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:55.221492 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] The token cache is being invalidate because project 407583643a5a4aebaf15ba89904ed049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:43:55.221937 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:55.222925 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG keystone.notifications [None req-0ef971be-f9ee-4b43-b922-6ad33c0905ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:43:55.225547 dv-cinder-850605-1-smb devstack@keystone.service[89166]: [pid: 89166|app: 0|req: 1455/2912] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Jul 28 06:43:55 2022] DELETE /identity/v3/projects/407583643a5a4aebaf15ba89904ed049 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:44:04.822118 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:05.215605 dv-cinder-850605-1-smb devstack@keystone.service[89166]: DEBUG dbcounter [-] [89166] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:07.366523 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Authenticating user token {{(pid=89167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:47:07.368065 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:47:07.457783 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fca8f-8b32-4540-8b99-5e6d3a1b4d64 admin admin] Validating token access rules against request {{(pid=89167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:47:07.535425 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8a6a-3a69-4299-aeaf-cc2eab6ca619 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2fd4c5e6d864ccd864a0114f5f5ff4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9e0b4663bd4b9a9f79e2bd9909935f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:47:07.536226 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8a6a-3a69-4299-aeaf-cc2eab6ca619 service placement] REQUEST_METHOD: `GET` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:47:07.536556 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8a6a-3a69-4299-aeaf-cc2eab6ca619 service placement] SCRIPT_NAME: `/identity` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:47:07.536836 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8a6a-3a69-4299-aeaf-cc2eab6ca619 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:47:07.539113 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.fernet_utils [None req-49cb8a6a-3a69-4299-aeaf-cc2eab6ca619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:47:07.552347 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8a6a-3a69-4299-aeaf-cc2eab6ca619 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:47:07.554048 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8a6a-3a69-4299-aeaf-cc2eab6ca619 service placement] RBAC: Authorization granted {{(pid=89167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:47:07.571805 dv-cinder-850605-1-smb devstack@keystone.service[89167]: [pid: 89167|app: 0|req: 1458/2913] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Jul 28 06:47:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:47:17.565753 dv-cinder-850605-1-smb devstack@keystone.service[89167]: DEBUG dbcounter [-] [89167] Writing DB stats keystone:SELECT=58 {{(pid=89167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}